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£T) ' Abstract 
i-H ! 

We study the capacity limits of real-time streaming over burst-erasure channels. A stream of source packets 
£N| ■ must be sequentially encoded and the resulting channel packets must be transmitted over a two-receiver burst- 

erasure broadcast channel. The source packets must be sequentially reconstructed at each receiver with a possibly 
different reconstruction deadline. We study the associated capacity as a function of burst-lengths and delays at the 
two receivers. 

We establish that the operation of the system can be divided into two main regimes: a low-delay regime and a 
large-delay regime. We fully characterize the capacity in the large delay regime. The key to this characterization 
is an inherent slackness in the delay of one of the receivers. At every point in this regime we can reduce the delay 
of at-least one of the users until a certain critical value and thus it suffices to obtain code constructions for certain 
critical delays. We partially characterize the capacity in the low-delay regime. Our capacity results involve code 
constructions and converse techniques that appear to be novel. We also provide a rigorous information theoretic 
q ■ converse theorem in the point-to-point setting which was studied by Martinian in an earlier work. 
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I. Introduction 



"TV elay is often ignored in the analysis of classical communication systems. Traditional error correction 
M W codes are designed to operate on message blocks, and can incur arbitrarily long encoding and 
decoding delays. In contrast several emerging applications are highly delay-sensitive. Both the fundamental 
limits and error correction techniques in such systems can be very different, see e.g., flD-trU^ an d 
references therein. 



X 

An information theoretic framework for the study of low-delay streaming codes has been introduced in 
ifTOl - lfm . The encoder observes a stream of source packets, and sequentially encodes it into a a stream of 
channel packets. The decoder is required to reconstruct each source packet with a maximum delay of T 
units. The proposed channel is a burst erasure channel. It can erase up to B packets in a single burst, but 
otherwise transmits each packet instantaneously. The maximum possible rate C (B,T) is characterized 
by proposing a coding scheme and proving a converse. We refer to this class of codes as streaming codes 
(SCo) throughout this paper. 

From a practical point of view, the (B, T) SCo code should be used over a burst-erasure channel, where 
the maximum length of any single burst is B and the guard interval separating multiple bursts is at-least T. 
Extensions of SCo codes thats correct both burst and isolated erasures have been recently developed [fT3l , 
lfl4l . Such codes were demonstrated to exhibit significant performance gains over the Gilbert-Elliott 

The corresponding author is Ashish Khisti (ashish.khisti@gmail.com). This work was supported by a discovery grant from National 
Science and Engineering Research Council of Canada, Hewlett Packard through a HP-IRP Award and an Ontario Early Researcher Award. 
Preliminary results of this work were presented at the 2010 Allerton Conference on Communication, Control, and Computing, Montecillo, 
IL. 
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Fig. 1. The source stream {s[i]} is causally mapped into an output stream {x[i]}. Both the receivers observe these packets via their 
channels. The channel introduces an erasure-burst of length Bi, and each receiver tolerates a delay of Ti, for i = 1,2. 

channel and Fritchman channel models, thus opening up the exciting possibility of developing structured 
codes for delay-constrained streaming communication in practical wireless networks. 

In this paper we are interested in a different extension of the SCo constructions. Instead of committing 
to a particular burst length B and delay T, our constructions adapt to the burst-length introduced by 
the channel. When the channel introduces an erasure-burst of length up to B\, the reconstruction-delay 
must be no greater than Ti, whereas if the burst- length is larger, say B 2 , the reconstruction delay can 
be increased to T 2 . Such constructions can be relevant for error concealment techniques such as adaptive 
media playback 03). Such methods adjust the play-out rate as a function of the receiver buffer size, so that 
a temporary increase in delay can be naturally accommodated. A natural way to study such constructions 
is to consider a multicast setup involving one sender and two receivers. The two receivers are connected 
to the sender over a burst-erasure broadcast channel and both the receivers are interested in reconstructing 
the same source stream, but with different delays. One receiver's channel introduces a burst of length B\ 
and the required reconstruction delay is Ti. The second receiver's channel introduces a burst of length B 2 
and the associated reconstruction delay is T 2 . We seek to characterize the multicast streaming capacity 
C(B 1 ,T 1 ,B 2 ,T 2 ) in this paper. 

In an earlier work [|T6l . we investigate the necessary and sufficient conditions under which C(B ly Ti, B 2 , T 2 ) 
C (Bi, Ti) (with B 2 > Bi). In particular, we show that if the delay T 2 of the weaker user is larger than a 
certain threshold, then the multicast capacity reduces to the single-user capacity of the stronger receiver. 
A particular code construction — diversity embedded streaming erasure codes (DE-SCo) — is proposed 
to achieve this capacity. In the present paper we obtain several new results. First, we observe that system 
performance can be divided into two operating regimes. When both the delays Ti and T 2 are smaller than 
certain thresholds the system operates in a low-delay regime. Otherwise it operates in a large-delay regime. 
In the latter case we identify a surprising slackness property and use it in our code constructions. The 
slackness property enables us to reduce the delay of either receiver 1 or receiver 2 to a certain minimum 
threshold without reducing the capacity. In the low-delay regime the characterization of the capacity is 
more challenging. We characterize the capacity for a subset of this region by proposing a new coding 
scheme and a matching converse. For the remainder of this region we propose an upper bound on the 
capacity, but leave open whether this bound is the true capacity. Preliminary results of our work appeared 
in 0/7). For related work see e.g., [Q~8l — [1271 and references therein. 



II. System Model 

Fig. Q] shows the proposed system model. The transmitter encodes a stream of source packets {s[t]} t > 
intended to be received at two receivers. The channel packets {x[t]} t > are produced causally from the 
source stream, i.e., 



x[t] = / t (s[0],...,s[t]). 



(1) 
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The channel of receiver i introduces an erasure-burst of length Bi i.e., the channel output at receiver i 
at time t is given by 



x[i] otherwise 

for z* = 1,2, and for some jj > 0. Furthermore, user i tolerates a delay of Tj, i.e., there exists a sequence 
of decoding functions 7i 4 (.) and 72t(-) such that 

m = Ht{yM, y t [l],...,y l [t + T i \), i = l, 2, (3) 

and Pr(s[t] ^ s[t]) = 0, Vt > 0, . 

The source stream is an i.i.d. process; each source symbol is sampled from a distribution p s (-) over 
some finite alphabet S. The channel symbols x[£] belong to some alphabet X. The rate of the multicast 
code is defined as the ratio of the (marginal) entropy of the source symbol to the alphabet size i.e., 
R = if(s)/log 2 \X\ and the multicast streaming capacity, C(Bi, T\, B 2 , T 2 ) is the maximum achievable 
rate. An optimal multicast streaming erasure code (Mu-SCo) achieves such capacity for a given choice 
of (Bi, Ti, B2, T 2 ). Without loss of generality, we assume throughout the paper that B 2 > B\. 

Note that our model only considers a single erasure burst on each channel. As is the case with (single 
user) SCo, our constructions correct multiple erasure-bursts separated sufficiently apart. Also we only 
consider the erasure channel model. More general channel models can be transformed into an erasure 
model by applying an appropriate inner code [[TO] Chapter 7]. 

III. Main Results 

To keep the paper self contained, we first briefly review the single user scenario lfT0l-lfl~2~l. We point 
the reader to these references as well as a summary in [fIFI for a more exhaustive treatment. 

A. Single-User Capacity 

Theorem 1 (Point-to-Point Capacity: KTW): The capacity of a point-to-point system described by ©, © 
and © (with % = 1) is 

C = I T+B — (4) 
\ T < B, K J 

where T\ and B\ are replaced by T and B for simplicity. 
The associated code construction involves a two step approach. 

• Construct a low-delay burst-erasure block code (LD-BEBC) that takes T source symbols, say (sq, • • • , st-i) 
and generates B parity checks, say (p 0) • • • ,Pb-i)- The resulting codeword x = (s , . . . , st-i,Po, • • • , Pb-i) 
has the property that it can fully recover all erased symbols from any erasure burst of length B. 
Furthermore each of the erased source symbols s, for i E {0, ...,T — 1} is recovered by time 
min {i + T,T + B}. An explicit construction of such a code is proposed in [flQl - [fT2l . 

• Apply diagonal-interleaving to the LD-BEBC code to construct the streaming code. 

The resulting streaming code is a time-invariant, systematic convolutional code of memory T, that takes 
in T source symbols at any given time and outputs T + B symbols^]. The converse is based on a 
periodic erasure channel argument, similar to the upper bounding technique used in classical burst-noise 
channels [29, Section 6.10]. The basic idea is to amplify the effect of a single isolated erasure burst into 
a periodic erasure channel and use the capacity of such a channel as an upper bound. We compliment 
this argument with a rigorous information theoretic proof for dU in Section [IV] The information theoretic 
proof is more general and provides a tighter upper bound when we consider the multicast setup. 



'in this work will not be using any special properties of convolutional codes |28| and the reader is not assumed to have familiarity with 
this topic. Some properties of SCo codes from the context of convolutional codes are discussed in 11 II . 1131 . 
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Fig. 2. Capacity behavior in the (Ti,T2) plane. We hold Bi and 
B2 as constants with (B2 > Bi), so the regions depend on the 
relation between Ti and T2 only. The red dashed line shows the 
contour of constant capacity in regions (a), (b), (c) and (d). 



Fig. 3. Capacity behaviour in the (B2, T%) plane. We hold B\ and 
Ti as constants, so the regions depend on the relation between T2 
and B2 only. The dashed line gives the contour of constant capacity 
in region (e) as well as in the special case of Ti = Bi in region 
(f). 



B. DE-SCo Construction 

In earlier work [16] Badr et. al consider the proposed multicast setup when the delay of the weaker 
user i.e., user 2 is sufficiently large. 

Theorem 2 (Badr et. al [16]): The multicast streaming capacity C(Bi, Ti, B 2 , T 2 ) in the regime where 
B 2 > B x and T 2 > aT x + B x (with a = Jj) is given by: 

The associated code construction — Diversity Embedded Streaming Codes (DE-SCo) — involves 
constructing two groups of parity checks: one along the main diagonal and the other along the off- 
diagonal and then combining these parity checks in a suitable manner. We refer the reader to ffl~6~l for 
the detailed construction. A converse argument is also provided in [fT6l to establish that T 2 is indeed the 
smallest possible threshold to achieve the rate of C\. 



C. Large Delay Regime 

The parameters of the DE-SCo construction in Theorem |2] fall within a larger class which we refer to 
as the large-delay regime. In particular if at-least one of Ti and T 2 is larger than a certain threshold: 

Ti > B 2 , (or) T 2 > B x + B 2 . (6) 

we have been able to determine the multicast capacity. In Fig. [2] this regime consists of all pairs (Ti,T 2 ) 
outside the rectangular box [T?i, B 2 ] x [B 2 , Bi + B 2 \. 
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Theorem 3: When the delays T\ and T 2 satisfy © and B 2 > Bi the multicast capacity is given by 

C u T 2 >aTt + B u 

C= J %^Bi> T 1 + B 1 <T 2 <aT 1 + B 1 , 

^ S Ti<T 2 <T 1 + Bi, K ) 

C 2 , T 2 < T v 

where Cj = ^ ;[' R is the single user capacity of user i — 1, 2 and we have defined a = j?-. □ 
The proof of Theorem |3J appears in section IV I 

Remark 1 (Delay-Slackness Property): A closer look at © shows that in each of the four cases the 
capacity only depends on either Ti or T 2 , but not on both of them simultaneously. In particular as shown 
in Fig. [2] the contour of constant capacity is a piecewise constant line. On the horizontal portions, the 
delay Ti can be reduced without reducing the capacity whereas on the vertical portions the delay T 2 can 
be reduced without reducing the capacity. This slackness in the delay of the receivers is rather unexpected 
and one of the surprises in this work. 

We next comment of the key ingredients in the proof of Theorem [3j The converse is obtained by 
combining the following upper bound with single user capacity bounds. 

Theorem 4: (Upper-Bounds via Periodic Erasure Channel) For any two receivers with burst-delay 
parameters of (£?!, Ti) and (B 2 , T 2 ), the multicast streaming capacity is upper-bounded by C < C + , where 

C+ = ! t,%% 2 T 2 >T 1 + B 1 , 

T 2 <T 1+ B t , w 

The proof of Theorem |4] is provided in section I VII I It involves simultaneously using the decoding 
constraints of both the receivers to obtain a tighter upper bound than a simple point-to-point bound. 

We next discuss the achievability part of Theorem |3] The first case in ©, i.e., when T 2 > aTi + B\ 
coincides with the condition of DE-SCo codes in Theorem |2] and thus © applies. The code construction 
associated with this region appears in [fl6l . The construction of the remainder of the cases in © exploits 
the delay-slackness property. The second case corresponds to region (b) in Fig.|2] where user 1 experiences 
slackness in its delay. We can reduce Ti so that we just hit the boundary of region (a) and then use the 
DE-SCo code construction. In contrast, region (c) in Fig. |2] which corresponds to the third case in (|7) 
involves slackness in the delay of user 2. We can reduce T 2 till we just hit the boundary of region (d). 
For region (d) it can be easily seen that a single-user code for user 2 is optimal. The details of the above 
reductions are presented in section [V] 

For a subset of region (a), where DE-SCo codes are optimal, we also propose a simpler construction 
— Interference Avoidance Streaming Codes (IA-SCo) that only requires us to construct two single user 
codes and combine the associated parity checks to avoid mutual interference. 

Proposition 1: (Interference- Avoidance SCo) An IA-SCo construction achieves a rate of C\ = T ^ Bl 
when B 2 = aB% (with a > 1 an integer) and 

T 2 > olT\ + Ti. (9) 

The region associated with © is marked by (a') in Fig. |2l 

The proposed scheme involves starting with single user streaming codes C\ : (B\,Ti) and C 2 : (B 2 ,T 2 ), 
delaying the parity checks of C 2 by Ti units and then directly combining them with the parity checks 
of C\ such that they do not interfere with one another. The complete IA-SCo construction is provided in 
Section. [VB 

D. Low Delay Regime 

We next consider the case when the delay pair (Ti, T 2 ) falls in the box [B%, B 2 ] x [B 2 , B\ + B 2 ] i.e., 

Bi<T x < B 2 , (and) B 2 <T 2 <B l + B 2 . (10) 
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C f <C+ = ^ — • (12) 



This regime appears to be more challenging and the capacity has only been established in some special 
cases. 

Theorem 5: (Capacity in Region (e)) The multicast streaming capacity in region (e) defined by Ti + 

Bx < T 2 < B 2 + B x and B 1 < Ti < B 2 is given by, 

T 

n — I 

e 2Tx + Bx + B 2 -T 2 

Note that the capacity expression C e only depends on B 2 and T 2 via the difference B 2 — T 2 . To identify 
the contour of constant capacity in the (e) region it is natural to fix B x and Ti and classify the various 
regions as shown in Fig. |3] Observe that the streaming capacity for any point in region (e) is constant 
across the 45-degrees line and is equal to the multicast upper-bound at the lowest point on the line 
separating regions (e) and (f) in Fig. [3] 

The complete proof for Theorem |5]is divided into two main parts. The achievability scheme is provided 
in Section IVIIII while the converse is given in Section [IXj The achievability involves first constructing a 
single user (Bx,Ti) SCo code for the first user and then carefully embedding additional parity checks to 
satisfy the decoding constraint of user 2. The converse too involves a new insight of revealing some of the 
source symbols to a virtual decoder to obtain a tighter bound than a periodic erasure channel argument. 

The remainder of the low delay regime is called region (f). The capacity remains open except in the 
special cases of either Ti = Bx or T 2 = B 2 . 

Theorem 6: (Upper-bound in Region (f)) An upper-bound on the multicast streaming capacity in 
region (f) defined by T 2 < T\ + B\ and T\ E [Bi, B 2 \ is given by, 

2(T 2 ~B l ) + (B 2 -T 1 

The above expression equals the streaming capacity if Ti = B\. 

The proof of the upper bound is given in Section [XH The code construction for Ti = Bx case appears 
in Section. 1X1 

The capacity has also been obtained when T 2 = B 2 for any Ti G [Bx, B 2 \. 

Theorem 7: (Capacity in Region (f) at (T 2 = B 2 )) The multicast streaming capacity in region (f) 
defined by T 2 < Ti + B% and Ti e [Bx, B 2 ] at the minimum delay case for user 2 (T 2 = B 2 ) is given by, 

T 

Cm=B 2) = ^r^. (13) 

The achievability scheme is based on concatenation of the parity checks of suitably constructed single- 
user codes and appears in Section IXIII The proof of the converse part for Theorem [7] is provided in 
Section IXIIIl The technique is significantly different than earlier converses and involves carefully double- 
counting the redundancy arising from the recovery of certain source symbols. 

This concludes the main results of the paper. 

IV. Converse Proof of Theorem CD 

In this section we provide an information theoretic converse to Theorem \T\ While the capacity of the 
point-to-point case was established in [fT0ll - [fT2l . the converse argument was based on a somewhat informal 
use a periodic erasure channel (PEC). Our information theoretic approach is not only more rigorous but 
also generalizes to the multicast setting in subsequent sections. Furthermore it has the following advantages 
over the PEC approach which might also be of interest. 

1) The PEC approach requires the channel packet x[£] is a deterministic function of the past source 
packets i.e., x[£] must be exactly computed given s[0], . . . , s[t\. The information theoretic converse 
does not impose this restriction and allows for e.g., stochastic encoders. 

2) The PEC approach as presented in IfTOl requires the code to be systematic. The information theoretic 
approach does not impose this restriction. 
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3) The PEC approach requires zero error in the recovery of each source symbol. The information 
theoretic approach can remove this restriction by suitably invoking Fano's inequality. 
Let us use the following notation: 



s[a], s[a + 1], . . . , s[b — 1], s[b], a <b 
0, otherwise 



(14) 



W 



W a ,W a+1 ,...,W b . 1 ,W b , a<b 
0, otherwise 



To aid us in our proof, let us introduce the terms 



V; 



(i+l)(T+B)-l 
i(T+B) 



(i+l)(T+B)-l 
i(T+B)+B 



(15) 



(16) 



where i = 0,1,2,.... Note that V{ refers to a group of source packets, whereas Wi is a group of channel 
packets. Fig. |4] shows the time slots that the packets come from while Fig. [5] shows the size of V{ and W^ 



V 



Vo 



V* 



Link: 



TTT 



W 



W x 



Wo 



Fig. 4. The periodic erasure channel used in proving the upper-bound of the single user scenario in Theorem Q] but with indication of 
which packets are in the groups Vi and Wi. Grey and white squares resemble erased and unerased symbols respectively. 



B 



Link: I 



B + T 

Fig. 5. One period of the periodic erasure channel in Fig. |4] with labels. 



We start with the following equations, which are a result of the (B, T) code. If the first B channel 
packets are erased, and then the next T channel packets are received perfectly, the (B,T) code can be 
used to recover the source packets s[0], . . . , s[B — 1]. Using the conditional entropy notation, this can be 
written as: 



His 



B-l 




W 



0. 



(17) 



Although the next T channel packets x 
source packets s 



B+T-l 
B 



B+T-l 
B 



are received, we cannot assume that the corresponding 
are able to be decoded because the code may not be systematic. To recover 

. In general, we 



2(B+T)-1 
(B+T)+B 



those source packets, we can use the next group of T unerased packets in x 
may not need all of these channel packets, but the proof is simpler if we have it all available. We can 
then write the relation using Fano's Inequality^! 



His 



B+T-l 
B 



X 



B-l 




Wo 1 



0. 



(18) 



2 The conditional entropy is zero because the receiver needs to perfectly recover each of the source packets with zero error. While we do 
not allow vanishingly small error probabilities at the decoder, the setup can be easily generalized in this case. 



8 



The equations (fT71 ) and <fT8l can be generalized to 

H(s 

His' 



i(B+T)+B-l 
i(B+T) 



i(B+T)-l 




(i+l)(B+T)-l 
i(B+T)+S 



i(B+T)+B-l 









(19) 
(20) 



Note that the above expressions still only assume that there was one burst erasure of length B. For 



instance, in (fT9l) , we assume that the packets x 



i(B+T)+B-l 
i(B+T) 



were erased so they are not used in the 



expression. 

Next, we will prove the following relation for n > 0: 

H(W") > H{V™~ X ) + h(w v 



n{B+T)-l 




For the base case, substitute n = into (|2T|) . This gives 

h(w )>h(v - 1 ) + h(w 



which is clearly true. We assume that (|2TT) is true for n = k in the induction step, 



H(W$) > H(V k ~ l ) +H[W, 



k(B+T)-l 




With the availability of Wk, one can use (|T9l to recover s 
follows, 



k(B+T)+B-l 
k(B+T) 



H(W£) > H ( Vq s 



k(B+T)+B-l 
k(B+T) 



+ H[W k 



k(B+T)+B-l 
k(B+T) 



(21) 



(22) 



(23) 

and (1231 can be re-written as 

(24) 



k{B+T)+B-l 




The detailed steps from (l23l) to (l24l is shown in Appendix. IA1 

Next, we add H(yVk+x\W^) to both sides and then use (|20l) to recover the source symbols corresponding 

to Wk, s ^o^tpo" 1 and the following can be written (c.f. Appendix. |A), 



(fc+l)(B+T)-l 




(25) 



From (|231 ) to (1251 ) and passing by (|24l . we have shown that if (|2T|) is true for n = k > 0, then it is 
also true for n = k + 1. Thus, by induction (|2TT) is true for n > 0. We take (|2TT) and finalize it as 



H{W?) > H(V C 



n-lN 



+ H(w n 



n{B+T)-l 




> Hiyr 1 ) 



(26) 



Next, we expand the groups of channel packets 
H(W£) = H[x\ 



\t+b-i 




2(T+B)-1 




~(n+l)(T+B)-l" 


) 


I B . 


X 


_(T+B)+B_ 


• • • X 


n(T+B)+B 





n T+B-l 

E ^Wi(T + B)+j]) = (n + l)-T.ir(x) 

i=0 j=B 

and also expand the groups of source packets 

ra(T+B)-l 



(27) 



n-lN 



(a) 



n(T+B)-l 



n(T+B)-l 




i=0 

#(s[i]) =n- (T + 5) -#(s 



i-l 




(28) 



i=0 
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where step (a) is because the source packets are independent. Then we can take (|26l) and write it as 

H(W n ) > HiVr 1 ) 
(n + 1) • T ■ H(x.) >n-(T + B)- H(s) 



(n+1) T H(s) 



n T + B ~ H(x) 
Finally, we conclude that any (B, T) streaming erasure code must satisfy 

which gives our upper bound of the rate. 

V. Proof of Theorem [3] 

For the converse we start with the upper bound in (|8) in Theorem |4] which we reproduce below for 
convenience. The proof of Theorem |4] appears section IVIII 

C+ -I t 2 % B +b 2 T 2 > Ti + Bi, 

IrSm T 2 <T 1 + Bl . (30) 



We further tighten the upper-bound in (j30b as follows, 



C u = mm {C + ,C U C 2 } 



mm 



T 2 -B 1 
T 2 -B 1 +B 2 



C U C 2 }, T 2 >T 1 + B 1 
T 2 < Ti + B x . 



Through straightforward calculations one can further simplify: 



mm 



mm 



Ti 



Ti+B 2 



T 2 < T x + B 1 



1 — ^ai 
T 2 -B 1 
T 2 -B 1 +B 2 

n a r 

T!+B 2 Uc ' 
^2 — ^d, 



T 2 > aT x + B 1 



C b , T x + B x < T 2 < aT x + B x 
Ti < T 2 < Ti + B v 
T 2 < Tl 



where recall that a = J 2 . This completes the proof of the converse. 
We discuss the code constructions for each of these regions below. 



(3D 



(32) 



A. Region (a) 

The code-construction achieving C\ in region (a) appeared in lfl6l . We summarize the key-steps for 
completeness and provide an example with {(B x , T x ) — (B 2 , T 2 )} = {(2, 3) — (4, 8)} in Table U which we 
will require in a subsequent example. We will assume for simplicity that B 2 = aB\ where a is an integer. 

• Generate a (Bi,Tx) SCo code (s[z],p[z]) consisting of T\ source sub-symbols and B\ parity check 
sub-symbols. Recall that the parity check sub-symbols are generated by applying a low-delay burst- 
erasure block codes (LD-BEBC) across the main diagonal of the stream of source sub-symbols. 

• Generate a (aB x , aT t ) SCo code (s[z], q[z]) consisting of T x + B\ sub-symbols where the parity check 
symbols q[i] are generated by applying a LD-BEBC across the opposite diagonal of the stream of 
source sub-symbols and with a interleaving factor of (a — 1). 
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S [t-1] 



si[i-l] 



s 2 [i-l] 



« [»] 



[i+i] 

S(,[i + 1] 



s 2 [i+l] 



Ei+2] 

s [i+2] 
si[i+2] 
s 2 [i+2] 



3] 



s [i+3] 
si[i+3] 
s 2 [i+3] 



Ei+j] 

s [i+4] 
si[t+4] 
s 2 [i+4] 



s [i-4]®s 2 [i-2] 



s 2 [i-9]ffiso[i-7] 



s [i-3]ffis 2 [i-l] 



s 2 [i-8]®s [i-6] 



s [i-2]©s 2 [i] 



s 2 [i-7]©s [i-5] 



s [i-l]ffis 2 [i+l] 



s 2 [i-6]ffis [i-4] 



s [i]®s 2 [i+2] 



fl2[i-5]e*o[»-3] 



s [i+l]ffis 2 [i+3] 



s 2 [i-4]ffis [i-2] 



si[i-4]©s 2 [i-3] 



«i[i-9]ffiao[*-8] 



si[i-3]ffis 2 [i-2] 



si[i-8]®s [i-7] 



si[i-2]ffis 2 [i-l] 



si[i-7]©s [i-6] 



si[i-l]ffis 2 [i] 



8i[i-6]ffi« [»-5] 



si[i]©s 2 [i+l] 



si[i-5]©s [i-4] 



si[i+l]ffis 2 [i+2] 



si[»-4]®s [i-3] 



5] 



[i + 6] 



[i + 7] 



z + 



[i + 9] 



i + 10] 



s [i+5] 
si[i+5] 
s 2 [i+5] 



so [«+6] 
si [i+6] 
s 2 [i+6] 



so [«+7] 
si [i+7] 
s 2 [i+7] 



s [i+8] 
si[i+8] 
s 2 [i+8] 



s [i+9] 
si[i+9] 
si [i+9] 



so [i+10] 
si [i+10] 
si [i+10] 



s [i+2]ffis 2 [i+4] 



s 2 [i-3]ffis [i-l] 



s [i+3]©s 2 [i+5] 



s 2 [i-2]ffis [i] 



s o [i+4]0s 2 [i+6] 



s 2 [i-l]®s [i+l] 



s [i+5]®s 2 [i+7] 



s 2 [i]®s [i+2] 



s [i+6]ffis 2 [i+8] 



s 2 [i+l]ffis [i+3] 



s [i+7]ffis 2 [i+9] 



s 2 [i+2]®s [i+4] 



si[i+2]®s 2 [i+3] 



si[i+3]®s 2 [i+4] 



si[i+4]ffis 2 [i+5] 



si[i+5]®s 2 [i+6] 



si[i+6]ffis 2 [i+7] 



si[i+7]®s 2 [i+8] 



si[i-3]ffis [i-2] si[i-2]®s [i-l] si[i-l]©s [i] si[i]®s [i+l] si[i+l]©s [i+2] si [i+2]®s [i+3] 



TABLE I 

Rate 3/5 DE-SCo construction that satisfy the region (a) point described by user 1 with (Bi,Ti) = (2, 3) and user 2 

WITH (B 2 ,T 2 ) = (2B 1 ,2T 1 +B 1 ) = (4,8). 



• The transmitted packet at time i is given by x[i] = p[i] + q[i — Ti]). 
We omit the steps in decoding as they are rather involved and refer to [|T6l . 



B. Region (b) 

In region (b) in Fig. [2] we show that the rate 



T 1 + B 1 <T 2 <aa , 1 + B 1 , 



T 2 — B\ + B2 
is achievable. 

Since the capacity does not depend on Ti, we can reduce the value of T x to l\ such that we meet the 
left hand side with equality i.e., we select 



which in turn implies that 



T 2 = aTi + Bi, 



f 1 = ^-(T 2 -B 1 ). 

-D2 



(33) 



Provided that Ti > B\ and furthermore Ti is an integer we can use a {(_Bi,Ti) — (T> 2 ,T 2 )} DE-SCo 
code |[T6ll to achieve - + * B = Cb and hence for the original point in region (b). The former condition 

is equivalent to T 2 > B 2 + B\ which naturally holds in region (b). If T\ it is not an integer a suitable 
expansion of every source symbol is needed as discussed below. 
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[z-1] 


W 






8 [t-l] 




s 3 [i-l] 




so[i] 




84 M 
S5[t] 


s [i+l] 
si[i+l] 
s 2 [i+l] 


s 3 [i+l] 
s 4 [i+l] 
s 5 [i+l] 




*i[i-l] 




84 [i-l] 




si[i] 






s 2 [»-l] 




s 5 [i-l] 




S 2 [l] 




s 3 [i-3]ffis 5 [i-2] 

© 

s 2 [i-5]ffis [i-4] 


s [i-2]©s 2 [i-l] 
© 

s 5 [i-5]ffis 3 [i-4] 


s 3 [i-2]ffiS5[i-l] 
© 

s 2 [i-4]©s [*-3] 




s [i-l]ffis 2 [i] 
© 

-5[*-4]©S3[*-3 


] 


8 3 [i-l]ffiss[i] 
© 

s 2 [i-3]ffis [i-2] 


so[«]ffis 2 [i+l] 
© 

s 6 [i-3]ffis 3 [i-2] 


84[i-3]e«a[i-2] 

© 

si[i-5]ffis 3 [i-5] 


si[i-2]©s 5 [i-2] 

© 

s 4 [i-5]©so[i-4] 


s 4 [i-2]ffis 2 [i-l] 
© 

si[i-4]ffis 3 [i-4] 


«i[i-l]ffi«5[i-l] 
© 

s 4 [i-4]ffiso[i-3] 


84[i-l]ffis 2 [i] 
© 

si[i— 3]©S3[i— J 


] 


si[i]©s 5 [i] 

© 

S4[i-3]ffis [i-2] 


z + 2] 








i + 4 


s [i+2] 
si[i+2] 
S2[i+2] 


s 3 [i+2] 
s 4 [i+2] 
s 5 [i+2] 


so[«+3] 
si[i+3] 
s 2 [i+3] 


ss[i+3] 
s 4 [i+3] 
s 5 [i+3] 


s [i+4] 
si [i+4] 
si [i+4] 


S3 [i+4] 
s 4 [i+4] 
s 5 [«+4] 


s 3 [i]@s s [i+l] 

© 

s a [i-2]ffia [i-l] 


so[i+l]©s 2 [i+2] 
© 

s 5 [i-2]©s 3 [i-l] 


S3[«+l]ffiS5[i+2 

© 

s 2 [i-l]ffis [i] 


] 


s [i+2]©s 2 [i+3] 

© 

s 5 [i-l]©8 3 [i] 


s 3 [i+2]ffis 5 [i+3] 

© 

s 2 [i]ffis [i+l] 


so[i+3]©s 2 [i+4] 

© 

s 5 [i]©s 3 [i+l] 


S4[i]©s 2 [i+1] 

© 

si[i-2]©s 3 [i-2] 


si[i+l]©s 5 [i+l] 

© 

s 4 [i-2]ffiso[i-l] 


S4[«+l]©s 2 [i+2] 

© 

8i[i-l]ffis 3 [i-l] 




u[i+2]ffiss[»+2 
© 

S4[l— l]©8o[i] 


] 


s 4 [i+2]ffis 2 [i+3] 

© 

si[i]ffis 3 [i] 


si[i+3]©s 5 [i+3] 

© 

s 4 [i]©so[i+l] 



TABLE II 

Rate 3/5 Mu-SCo construction that satisfy the region (b) point described by user 1 with (Bi,Ti) = (1, 2) and user 2 

WITH(B 2 ,T 2 ) = (2,4). 



• Split each source symbol into n 2 Ti sub-symbols So[i], . . . , s n2 ^ i _ 1 [z] where n is the smallest integer 
such that nTi is an integer. 

. Construct an expanded source sequence §[■] such that s[ni + r] = (s rn fjz], . . . , S( r+1 wf' 1 _ 1 [i]) where 
r G {0, . . . ,n — 1}. 

• We apply a DESCo code with parameters {(nB, nT\) — (naB, n(aTi + B))} to §[•] using the earlier 
construction. 

With the channel of user 2 introducing 5 2 erasures on the original input stream, there will be nB 2 
erasures on the expanded stream. These will be decoded with a delay of n{aT\ + B) = nT 2 on the 
expanded stream, which can be easily verified to incur a delay of T 2 on the original stream. 

For user 1 the expanded source stream incurs a delay of nTi, which reduces to a delay of \T{\ on the 
original stream. This suffices the requirements of user 1 as by construction T\ > \T{\ . 

We provide a numerical example below. 

1) Example — Source Expansion: Consider a Mu-SCo with parameters {(1,2), (2,4)} which falls in 
the (b) region. The capacity is given by R = 3/5. The construction is provided in Table lU Through direct 
calculation note that T\ = 1.5. Hence we implement a source expansion technique with n = 2 as follows. 

We split each source symbol s[i] into six sub-symbols sq[i\, . . . , ss[i] and construct an expanded 
source sequence §[■] such that s[2i] = (so[i], Si[i], S2I*]) an d §[2z + 1] = (ss[i], s 4 [i], s 5 [i}). We use the 
{(2, 3), (4, 8)} DE-SCo code (see Table U) that we apply to §[•] to produce the parity checks p[-] and 
transmit p[i) = (p[2i],p[2i + 1]) along with s[i] at time i. It can be verified directly that the resulting 
code corrects a single erasure with a delay of 2 symbols and an erasure-burst of length 2 with a delay of 
4. 
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(a) IA-SCo Code Construction for (s 1 ,t 1 )=(i,2) and (b 2 ,t 2 )=(2,6) 





w 


[i+1] 


[i + 2] 


[i + 3] 


[i + 4] 


«o[»— 1] 


so [i] 


so [i+1] 
«i[i+l] 


s [i+2] 
si[i+2] 


so [i+3] 
si[i+3] 


so [i+4] 

Si [i+4] 


si[*-l] 


si[i] 


s [i-3]ffisi[i-2] 
© 

3 [i-7]©«i[i-5] 


s [i-2]©si[j-l] 

© 

s [i-6]ffisi[i-4] 


s [i-l]©si[i] 


s [i]©si[i+l] 
© 

s [i-4]ffisi[i-2] 


s [i+l]ffisi[i+2] 

© 

s [i-3]ffisi[i-l] 


s [i+2]ffisi[i+3] 

© 

s [i-2]ffisi[i] 


© 

s [i-5]ffisi[i-3] 



(b) DE-SCo Code Construction for (s 1 ,r 1 )=(i,2) and (b 2 ,T2)=(2,5) 



[i-1] 




[< + l] 


[i + 2] 


[< + 3] 


[i + 4] 




s [i-1] 






soft] 




s [i+l] 
si[i+l] 


s [i+2] 
si [i+2] 


s [i+3] 
si[i+3] 


so [i+4] 
si [i+4] 


si 


si[i] 


s [i-3]ffisi[i-2] 

© 

si[i-6]ffis [i-5] 


s [i-2]ffisi[i-l] 
© 

si[i-5]ffis [i-4] 


soIi-lJffisrW 

© 

sift-4]ffis [i-3] 


s [i]ffisi[i+l] 

© 

si[i-3]ffls [i-2] 


s [i+l]ffisi[i+2] 

© 

si[i-2]ffls [i-l] 


s [i+2]ffisi[i+3] 

© 

si[i-l]©s [i] 



TABLE III 

Rate 2/3 code constructions that satisfy user 1 with (Si, T%) = (1,2) and user 2 with B 2 = 2. The two points 

{(1, 2) - (2, 6)} AND {(1, 2) - (2, 5)} lies in region (a). 



C. Region (c) 

Region (c) is sandwiched between T\ < T 2 < T\ + Bi and also satisfies T\ > B 2 in Fig. [2j The capacity 
is given by 

For the achievability scheme, we use an approach similar to region (b). We can reduce the delay T 2 
of user 2 in region (c) so that it meets the T\ = T 2 line without changing the capacity C c . We can then 
apply a single user (B 2 , Ti) code that simultaneously satisfies both the users. Clearly this code is feasible 
since T x > B 2 . The rate of this SCo code meets the capacity. Note also that we do not require source 
expansion in this step. 



D. Region (d) 

In this region T 2 < T\ and B 2 > B\. It suffices to serve user 2 and the upper bound shows that the 
capacity Cd = C 2 is also achieved using a single user SCo of parameters (B 2 ,T 2 ). 

VI. IA-SCo Construction (Proposition [B 

We first provide a simple example to illustrate the main idea behind IA-SCo and then provide the 
general construction. We note that the IA-SCo codes achieve the capacity in a subset of region (a) in 
Fig. [2l While IA-SCo codes do not provide any new capacity results, their construction is much simpler 
than DE-SCo and perhaps easier to generalize when there are more than two receivers. 



A. Example 

Consider an example with the first and second users experiencing burst erasures of length B\ — 1 and 
B 2 = 2 symbols respectively (i.e., a = 2) and the corresponding delay for the first user is T\ = 2. From 
Prop. [l]we have that T 2 = 6. Table ITllTa) illustrates the IA-SCo construction. For comparison the optimal 
DE-SCo construction achieving T 2 = 5, proposed in [fT6l is provided in Table ITTlT b). 
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The construction of the IA-SCo code is as follows. We split each source symbol s[i] into two sub- 
symbols s [i] and si[i] of equal size. Letpifi] = s [i — 2] ffisjfi — 1] be the parity check associated with the 
(1,2) SCo-code 0H and let p 2 [i) = s [i - 4] © si[i - 2] be the parity check for the (2, 4) SCo-code IfTOl . 
The parity check row is obtained by combining q[i] = pi[i) @p 2 [i — T\] i.e., by shifting p 2 [i) by T\ units 
and then combining. The parity check stream q[] are then concatenated with the source symbols as shown 
in Table IMa). 

When an erasure of one symbol occurs say at t = i — 1 for user 1, it needs to recover s[i — 1] at 
time t = i + 1. Note that user 1 can cancel the second row of parity checks p 2 [-], which combines 
unerased sub-symbols. For user 2 suppose that a burst erasure of length B 2 = 2 symbols occurs at times 
t — % — 2, i — 1. User 2 simply ignores the parity checks q[i] and q[i + 1]. Starting from t — i + 2, the 
parity checks pi[-] are functions of symbols s[i], s[i + l], . . . and do not involve the erased symbols s[i — 1] 
and s[i — 2]. Therefore we can subtract pi[-] from q[i + 2], . . . , q[i + 6] and recover p 2 [i), . . . ,p 2 [i + 4], 
which suffice to recover the missing symbols. 

B. General Construction 

The main idea behind the general construction is to start with two single-user codes for the two users, 
(B 1 ,T 1 ) and (aBi,aTi) and delay the parity checks of the second by 7\ so that they can be combined 
with the parity checks of user 1 without causing any interference to the two users. 

Throughout our discussion we let Ti = T and B\ = B and B 2 = aB and T 2 = aT + T. 

1) Code Construction: 

• Let C\ be the single-user code of user 1 [10], lfi~6l . Assume that the source symbols s[i] are divided 
into T sub-symbols (so[i], . . . , st-i[«]) and combined to produce B parity check sub-symbols p l [i] = 
(pl[i}, . . . ,p l B _ x \i}) according to 

p}\i] = Sj [i -T] + hjisBii - (j + T - B)}, . . . , ST _i[z - (j + 1)]), j = 0, . . . , B - 1. (35) 

• Let C 2 be a rate C\ SCo with parameters (aB, aT) also obtained by splitting the source symbols into 
T sub-symbols (s [i], . . . , s T -i[i]) combined to produce B parity checks p n [i] = ■ ■ ■ ; p"-i[^]) 
according to the vertical interleaving property in [H6l , i.e., 

pf[i] = Sj [i - aT] + h 3 (s B [i — a(j + T — B)], . . . , sr-i[i - (j + 1)"]), 3 =0,...,B-1. (36) 

• Construct Cm whose symbols have the form (s[z], q[i]), where q[i] = p 1 [i] + p n [i — T] . Intuitively the 
stream of parity checks p n [-] is delayed by T symbols and then the resulting non-interfering streams 
are combined. 

Clearly the rate of Cm equals C\. We need to show that user 1 and user 2 can recover from erasure 
bursts of B and B 2 = aB within delays of T and T 2 = aT + T respectively. 

2) User 1 Decoding: Assume that the symbols at time i, . . . , i + B — 1 are erased on user l's channel. 
By virtue of C\, symbol s[i + k) (for k — 0, 1, . . . , B — 1) can be recovered by time i + k + T using parity 
checks p l [i + B], . . . , p l [i + k + T\. Thus it suffices to show that we can recover p l [i + k] from q[i + k] 
for k = B,...,B + T-l. 

First note that the p l [i + k] for k = B, . . . , T can be directly recovered from q[i+&] since the interfering 
parity checks p n [-] only consist of source symbols before time i. Indeed the parity check at k = T is 

q[z + T] = p I [2 + T] + p II [^] 

and from (1361 ) the sub-symbols in p u [i] only depend on the source symbols before time i. Thus upon 
receiving q[i + T] user 1 can recover the erased symbol s[i). Furthermore, we can also compute p n [i + 1] 
which only consists of source symbols up to time i and upon receiving q[?+T+l] can compute p ! [i+T+l] 
from 

p^i + T + 1] = q[z + T + 1] - p n [z + 1]. 
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T=2 (code 
I \ 

HQHHH HHHHH HQHHH 

I t 

T=4 (code C 2 ) 



(a) Step (1) (b) Step (2) (c) Step (3) 

Fig. 6. Main steps of finding the upper-bound for the {(1, 2) — (2, 4)} point through one period illustration of the Periodic Erasure Channel. 
Grey and white squares resemble erased and unerased symbols respectively. 



In turn it recovers s[i + 1]. Continuing this process it can recover all the erased symbols s[i + k] by time 

i + T + k. 

3) User 2 Decoding: Suppose that the symbols at time i, . . . , i + B 2 — 1 are erased on user 2's channel. 
By virtue of C 2 , symbol s[i + k] (for k = 0, 1, . . . , B 2 — 1) can be recovered by time i + k + aT 
using parity checks p n [i + B 2 ], . . . , p n [i + k + aT). To establish © it suffices to show that symbols 
p n [i + B 2 ], . . . , p n [i + k + aT] can be recovered from symbols q[i + T + B 2 ], . . . , q[i + k + aT + T\. 
Indeed since 

q[i + B 2 + T] = p l [i + B 2 + T] + p u [i + B 2 ), 

it suffices to observe that user 2 can cancel p l [i + B 2 + T] upon receiving q[z + B 2 + T\. It however 
immediately follows from (|35l ) that p l [i + B 2 + T] involves source symbols at time i + B 2 or later (the 
construction limits the memory in the channel input stream to previous T symbols). The symbols p : [-] 
after this time also depend on s[-] at time i + B 2 or later. 

VII. Proof Of Theorem @] 

We first provide an example to illustrate the upper bound using periodic erasure channel. Then we outline 
the general periodic erasure channel (PEC) based argument. Finally we provide a rigorous information 
theoretic converse. 



A. Example 

The main steps of this proof can be illustrated by first considering a specific example, {(1, 2) — (2, 4)} 
which is shown in Fig. [6l We consider a periodic erasure channel with each period having two consecutive 
erasures followed by three unerased symbols. Thus, one can start by using code C 2 = (2, 4) to recover 
the erasure at time 0, wtih a delay of 4, leaving only one erasure at time 1 (c.f. Fig. |6(b)[ ). Now, code 
C\ = (1, 2) can be used as it is capable of recovering this one erasure within a delay of 2 (i.e., by time 3) 
(c.f. Fig. |6(c)[ ). Let us assume that the code is systematic and thus one can recover the symbols at time 



2, 3 and 4 from their corresponding unerased channel symbols. Thus, one can recover a total of 5 source 
symbols from 3 unerased channel symbols which implies that 3/5 is an upper-bound of this channel. 

B. PEC based Converse 

For the general case of Theorem |4] we start by the case, T 2 > T\ + B\ and then consider T 2 <Ti + B\. 

Lemma 1: When T 2 > T\ + Bi, suppose there exists a sequence of feasible encoding functions {/*(•)} 
and decoding functions {7it(-)} and {j2t{-)}- Then there also exist decoding functions jt(-) that can 
reproduce the source symbols s[t], over a channel with periodic bursts as stated below 

M = J*' ^[^,^ + 52-1] 
y[J |x[t], te [T k + B 2 ,T k+1 -l] K } 

where T k = kT 2 + k(B 2 - B x ), k = 0,1,... 
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c = T 2 + B 2 - Bi c = B 2 + Ij 

% T 2 
Link: I I I I I mT| I I I I I I I I I I I I I I I I I I I I I I Link: I I I I I mT| I I I I I I I I I I I I I I I I I I I I I I 

a = B 2 — B t Bi Ti a = B 2 - Bi B x T L 

b = B 2 b = B 2 

(a)T 2 >T 1 +B 1 . (b)T 2 <Ti + Bi. 

Fig. 7. One period illustration of the Periodic Erasure Channel in Fig. [4] to be used for proving the multicast upper-bound provided in 
Theorem [4] 



An illustration of one period of the proposed periodic-erasure channel (from T° to T 1 ) in the case 
T 2 > Ti + Bi is shown in Fig. [7£a). The capacity of the periodic erasure channel in Lemma [TJ is 

C < T2 ~ Bl , (38) 
T 2 — B\ + B2 

To establish Lemma [Q it suffices to show that by time T k — 1, the receiver is able to recover 
symbols x[0], . . . , x[T k — 1]. We first show that by time T 1 — 1, the receiver is able to recover symbols 
x[0], . . . , x[T x — 1]. Since only symbols x[0], . . . , x[B 2 — 1] are erased by time T 1 — 1 we focus on these 
symbols. 

Consider a single-burst channel that introduces a burst of length B 2 from times t = 0,1, . . . , B 2 — 1. 
Note that this channel behaves identically to the periodic burst channel up to time T 1 — 1. Applying 
the decoder j 2t (•) for t = 0, 1, ... , (B 2 — £>i) — 1, the receiver recovers symbols s[0], . . . , s[t] with a 
delay of T 2 i.e., by time T 1 — 1 and hence it also recovers the channel packets x[0], . . . , x[£] via ©• It 
remains to show that the symbols at time t = (B 2 — Bi), . . . , B 2 — 1 are also recovered by time T 1 — 1. 
One cannot apply the decoder r ) 2t {-) to recover these symbols since the decoding will require symbols 
beyond time T 1 , which are available on the single-burst channel but not on the periodic burst channel. 
However, to recover these symbols we use the multicast property of the code as follows. Consider a 
channel that introduces a single erasure burst of length B\ between times t = (B 2 — Bi), . . . , B 2 — 1. 
Note that up to time T 1 — 1, this channel is identical to our periodic burst-erasure channel (which has 
recovered x[0], . . . , x[£? 2 — B\ — 1]). For this channel, and hence the periodic erasure channel, using the 
decoder 7it(-) the source symbols are recovered by time B 2 + Ti — 1 < T 1 — 1. Furthermore via ©, the 
erased channel symbols x[B 2 — Bi], . . . , x[B 2 — 1] are also recovered by time T 1 — 1. Since the channel 
introduces periodic bursts, the same argument can be repeated to recover all symbols up to time T k — 1 
for each k. 

The same argument applies in the case when T 2 < Ti + Bi (in Fig. |7J(b)) except that the periodic 
bursts are stated as, 

(*, te [l*,l* + B,-l] 
y " \x[f], te [T k + B 2 ,T k * 1 -l\ 

where T k = k{T\ + B 2 ) and the theorem follows. 



C. Information Theoretic Converse 

Recall that our PEC argument assumed that (1) the channel packets x[t] are deterministic functions of 
the source packets up to time t, (2) the channel code is systematic and (3) the recovery must happen with 
zero error. All of these assumptions can be removed by resorting to the information theoretic converse 
discussed next. 

We start by proving the first case T 2 > Ti + £?i. We use the periodic erasure channel shown in Fig. |7](a), 
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where each period has B 2 erasures followed by T 2 — B\ non-erasures. We can assign 
a = B 2 - B u b = B 2 , c = B 2 + T 2 - B x (period length), 



(i+l)c-l 
ic+b 



Vi 



(i+l)c-l 



We define the capability of the d = (B 1 ,T 1 ) and C 2 = (B 2 ,T 2 ) codes by, 







i+Ti 
_i+Bi_ 


X 


i-l 



i+T 2 ' 
i+B 2 


X 


i-l 




H(s\i] 

We use mathematical induction to prove that for n > 

H(W£) >H(V n ^) + H(w n 
The base case for (|42l) is given by substituting n = into it: 

H(W ) > H{V l ) + h(w V^x 



nc—l 




-1 




> H{W 



which is obviously true. For the induction step, let us start by assuming that (1421) is true for n = k, 



H{W*) > H(V k - 1 ) + H[W, 



fec-l 




(40) 
(41) 

(42) 

(43) 

(44) 



In the first part of the induction step, some entropy manipulations are applied (c.f. Appendix. |B]), to 
show that: 



kc+b-l 
kc 



+ H[W, 



kc+b-l 
kc 



kc+b-l 




(45) 



These entropy manipulations can be summarized in two main steps, the first of which is recovering the 



first a = B 2 — Bi source symbols, s 



fcc+a— 1 
kc 



using code C 2 defined in (|4T1) due to the availability of 

using C\ defined 



kc+b-l 
kc+a 



Wk, while the second step is recovering the next b — a = B\ source symbols, s 
in (|40|>. 

In the second part, we add H{W^+i\Wq) to both sides of the inequality. Because the channel code is 
not necessarily systematic, we will use the additional channel packets in Wk+i to help decode the source 

packets s ^tT 1 (detailed steps are shown in Appendix. |B]). 



H(W* +1 )>H(V k ) + H(W k+1 



(fe+l)c-l 




(46) 



The working in (|46T ) shows that if (|42l) is true for n = k, then it is also true for n — k + 1. By 
induction, (1421) is true for n > 0. Finally, 



h(Wq) > Hiy^ 1 ) + H(w n 



nc—l 




n-l> 



Using the fact that all of the channel packets have the same entropy, and all of the source packets have 
the same entropy, we can continue to get 

H(W£) > H{Vr X ) 
(n + 1) • (T 2 - B x ) ■ H(x) >n-(T 2 + B 2 - B x ) ■ H(s) 
n + 1 



T 2 -B x > H{s) 
T 2 + B 2 -B 1 ~ H{x) 



(47) 
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Finally, we get 

Therefore, any {(B X ,T X ), (B 2 ,T 2 )} code with T 2 > T x + Si must satisfy (|48]). 

For the case with T 2 < T\ + B\, the same proof applies except that the values of a, b and c are updated 
as follows, 

a = B 2 -B 1 , b = B 2 , c = B 2 + T 1 (period length), 
and again we end up having, 

H{W%) > Hivr 1 ) 

(n + 1) • 7\ • #(x) > n ■ (Ti + £ 2 ) • #(s) 

ILtl ._?!_> £W. (49) 
n T x + B 2 ~ #(x) 

In other words, 

R = II £ tTTTv (as " TC) (50) 

Therefore, any (B^Tx), (B 2 ,T 2 ) code with T 2 < T\ + ^ must satisfy (|50l). 

VIII. Code Construction in Region (e) (Theorem [5]) 

Recall that region (e) in Fig. |2]and Fig. [3]is contained within T 2 > B 1 + T 1 , T 2 > B 2 and T 2 < B x + B 2 . 
Since the capacity C e given by 

C e = — (51) 

e 2T 1 + B 1 + B 2 -T 2 

is constant along each 45-degree line starting from the line T 2 = B 1 + T\ in the (B 2 , T 2 ) plane in Fig. [31 
we can parameterize the T 2 and B 2 as 

T 2 = T Y + B 1 +m, B 2 = T 1 + k + m, 

where m > is the number of steps upwards on the 45 line in Fig. |3] starting from T 2 = T\ + i?i line 
dividing regions (e) and (f), and where k is an integer taking values from to B x , which horizontally 
spans region (e) from T 2 = Bi + B 2 to T 2 = B 2 . Substituting into (I5TI) we have 

C e = Tl , , (52) 
2Xi + A; 

which we will show is achievable. 

In Appendix O we provide two examples of the code constructions with parameters {(4, 5), (7, 10)} 
and {(3,5), (7,9)}. These examples compliment the general description below and might be worthwhile 
reading in parallel with this section. 

The construction generates three layers of parity checks and carefully combines them to satisfy the 
decoding constraints of both the receivers. The main construction steps are described below. 

• Split each source symbols s[i] in T\ sub-symbols 

s[i] = (s [z],...,s Tl -i[i]) 

. Apply a Ci = {B\,Tx) single user SCo code to the source symbols s[i] producing B\ parity check 
sub- symbols 
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at each time by combining the source sub- symbols along the main diagonal, 

p)\i} = Sj [i - Ti] + hf{s Bl [i — j — Ti + Bi] , . . . , s Tl -i[i — j — 1]), j = {0, 1, . . . , B x - 1}. 

• Apply a C 2 repetition code to the source symbols s[i) with a delay of T 2 , i.e., the corresponding 
parity check symbols are, 

p n [*] = (p°[i], . . . , j^.Ji]) = (s [i - T 2 ], . . . , Sli -i[i - T 2 )) = s[i - T 2 ). (53) 

• Concatenate the two streams p ! [-] and p n [-] with a partial overlap as illustrated in (1541. In particular, 
the two streams of parity checks p J [-] and p n [-] are concatenated with the last B\ — k rows of the 
first added to upper most B\ — k rows of the second. 



so * 



Pot*] 



(54) 



Pb x -i[«] +s Bl -k-i[i-T 2 ] 
SB!-k[i - T 2 ] 



s Tl -i[i - T 2 ] 

We further combine the last 7\ — (Bi — k) parity checks of p n [-] with additional parity checks of 

code C 3 as explained below. 
• Consider the two cases: 
(A) T x < 2(5! - k) 

- Apply a C 3 = (B 3 , T 3 ) = (Ti — (Bi — k), B x — k) single user SCo code on the last B\ — k parity 
check sub-symbols of C\, (p\[-}, ■ ■ ■ ,p Bl -i[-}) constructing T% — (Bi — k) parity checks 

P 3 W = (p 3 o\i\,---,PT 1 -{B 1 -k)-l\ i \) 

at each time by combining the last B x — k parity check sub-symbols, (p\[.}, . . . along 
the main diagonal, i.e., 

P 3 M = Pl +j [i ~ Ts] + h%p\ +B3 [i -j-T 3 + B 3 ], . . . J k+T3 _S ~ J ~ 1]), 

fotj = {0,l,...,T 1 -(B l -k)-l}. 

- Combine a A 3 = —T\ shifted version of the produced stream of parity checks p 3 [.] to the last 
Ti — (Bi — k) rows of x[.], thus, 
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XI 



Pk- 



PkV\ +s [i-T 2 } 



s Bl _ fc [i-T 2 ] +pl[i + T l \\ 



s Tl -i[i-T 2 ] +p 3 Ti _ 



■(Bi-fe)- 



-l^ + ^l] 



(55) 



where 



P 3 [^l]L 2 = (P?[*l]L,---,PT 1 -(B x -fc)-l[*l]L) 



is the parity-check p 3 [ti] shifted to time £ 2 - 
We note that the construction of x[i] in (1551) requires us to have access to source symbols after 
time i as the parity checks p 3 [z + may include source symbols after time i. Since our encoder 
is causal we cannot have access to these source symbols. Instead we transmit only the causal part 
of the underlying parity checks. In particular, we decompose each parity check into two parts as 
follows. For any t 2 < t x we have, 



t-2 



1*2 



(56) 



where p 3 [ti]| ta denotes the causal part of the parity check with respect to t 2 whereas pj[ti 
denotes the non-causal part of the parity check with respect to t 2 i.e., 

= / i (s[t 2 ],s[t 2 -l],s[t 2 -2]...) 



It 2 



p)U 



9j (s[t 2 + l],s[t 2 + 2]...). 



(57) 
(58) 



The resulting input symbol at time i is given by 



8 [i] 

p l M 



pIS] 

Pkli] +s [i-T 2 



Pbi-iIH +s Bl -k-i[i 
s Bl -k[i-T 2 ] +pf ) [i + T 1 ]\ 



To 



(59) 



s ri _i[i - T 2 ] +P 3 Tl _ [Bl _ k) _ 1 [i + 

The symbol x[i] in (l59l is the transmitted symbol at time i. 

(B) T a > 2(5! - fc) 

Since, Si — k > T x — (Sj — fc), a SCo of parameters (T x — [B\ — k), B x — k) constructed in case 
(A) is not feasible and is thus replaced by a set of SCo codes. For the associated values of T x , B 1 
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and k we let 

Tx - (B 1 - k) = r(Bt -k)+q, q < {B x - k). (60) 

- Let 

C 3 ,n = (B 3 , n , T 3>n ) = (B 1 -k,B 1 -k), n = 1, . . . , r, 

be a set of r SCo repetition codes applied on the last B x — k parity check sub-symbols 
(p\ [i],... ,P Bl -i[i\) and repeating them to construct r sets of parity check vectors each of 
size Bi — k as follows, 

p 3 ' n [*] = (Pom • • ■ ,p£r-*-iH) = + ^ - • • • A-iP + "(^i - ( 61 ) 

at each time, i.e., a C3 jn code is a (£>i — k, Bi — k) SCo repetition code shifted back by 
{n + \){B x -k). 

- Let C 3if+ i be a (5 3>T . +1 , T 3>T . +1 ) = (q, B 1 — k) SCo again applied on the last B x — k par- 
ity check sub-symbols (p\[i), ■ ■ ■ >.Pbi-i[*]) an( ^ men constructing g parity checks p 3 ' r+1 [i] = 
(Po' r+ • • • jpI-i 1 ^}) at eac h time by combining the last B x — k parity check sub-symbols, 
(p\[.], ■ ■ . ,p l Bl -i[-]), along the main diagonal. 

- Concatenate the set of streams p 3 ' n [.] for n — 1, . . . , r and p 3,r+1 [.] after introducing a shift of 
^3,r+i = —T\ in the later. The output symbol at time i is, 



(62) 



where 

(pBh, • • • ^- { B,- k) -M) = (p 3 ' 1 ^!,, • • • , p 3 ' r wL, p 3 ' r+1 [* + ni) (63) 

is the concatenation of the r + 1 parity check sub-streams for the codes C 3 n for n = 1, . . . , r + 1, 
respectively. Since each of the first r of these sub-streams is composed of B\ — k parity check 
sub-symbols while the last of which is composed of q parity check sub-symbols, then the 
p 3 [z] has a sum of r(B\ — k) + q = T\ — (B\ — k) parity check sub-symbols which will be 
denoted by the parity check sub-symbols of code C 3 (the set of codes {£3,1,(^3,2, . . . ,£3,^+1}), 
and hence can be combined with the last T\ — (B t — k) parity check sub-symbols of code C 2 , 

(pg l _ fc [<] > ... ) ^-iM)- 

Since there are 7\ source sub- symbols and two streams of parity checks one with B\ and the other 
with Ti parity check sub- symbols for every T\ source sub- symbols but partially overlapping in B\ — k 
rows, it follows that the rate of the code is 2Ti+Bi T ^ Bi _ fc - ) = 2 T\+k = ^ e ( c -^ Fig- ©■ 



s[z] 

p l M 



V l S\ +s [t-T 2 ] 

Pb.-M +s Bl -k-i[i ~ T 2 ] 

s Bl -k[i-T 2 ] +pl[i] 

s Tl -i[i-T 2 ] +Pl 1 - {Bl - k )-M 



A graphical representation of such coding scheme is illustrated in Fig. [8j The horizontal axis represents 
time while the vertical axis represents the index of sub-symbols in the channel symbol at each time instant. 
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k 



B, 



t=[i-BJ t=[i] t 3 =[i+B r k] t=[i+TJ 

=[i-B 2 +T 2 ] 



Layer (1) 



Layer (2) 



Layer (3) 



Layer (4) 



t s =[i+TJ 



^S[.] 



p 3 [.] 



V 

Erased 



P 3 [-] 



P1-] 



p n [t]=s[t-T 2 ; 

y 



Non-Erased 



Fig. 8. A graphical illustration of both the Encoding and Decoding Steps for a general point lying in the (e) Region. The labels on the 
right show the layers spanned by each set of parity check sub-symbols. The labels at the bottom show the intervals in which each set of 
parity check sub-symbols combine erased source sub-symbols. 



We divide each channel symbol into four layers, 

• Layer (1) contains the T\ source sub-symbols 

• Layer (2) contains the first k of the B t parity check sub-symbols, p*[-] produced by code C% 

• Layer (3) has the remaining Bi — k parity check sub-symbols of C% combined with the first 
B\ — k of the the parity check sub-symbols, p n [-] produced by the repetition code, C 2 . 

• Layer (4) has the remaining T\ — {B\ — k) parity check sub-symbols of C 2 combined with the parity 
checks of C 3 . 

Note that two overlaps between codes exist in this coding scheme. The first is between codes C\ and C 2 
and takes place in layer (3), while the second is between C 2 and C 3 and takes place in layer (4). 

A. Decoding of User 1 

A burst erasure of length B\ in the interval X\ = [i — B\,i — 1] can be directly recovered using the 
stream of parity checks p J [-] in the interval + T\ — 1] = [£2,^4) (c.f. Fig. [8]) produced by code C\ 
within a delay of T\. The overlapping parity checks p n [i] = s[t — T 2 ] in this interval consist of source 
symbols from the interval X 2 = [i — T 2 , i + T x — T 2 — 1] = [i — T\ — Bi — m, i — Bi — m — 1] which are 
unerased (i.e., X 2 fl Ii = $ since m > 0). 
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B. Decoding of User 2 

Suppose that the symbols in the interval X 2 = [i — B 2 , i — 1] are erased by the channel of user 2. We 
start by summarizing the main decoding steps. Thereafter we describe each step in detail. 

. Step (1) (Recovery of p : [-]): The parity checks of code C 3 , p 3 [-] in the interval [i, . . . , i + T 2 — B 2 — 1] 

(in layer (4)) are capable of recovering the last B\ — k sub-symbols of p ! [t] for t 6 {i+T 2 — B 2 , . . . , i+ 

T x - 1} by time t. 

. Step (2) (Removal of p : [-]): Subtract p*[-] in layer (3) starting at % - B 2 + T 2 . 

. Step (3) (Removal of p 3 [-]): Compute and subtract p 3 [-] in layer (4) starting at % — B 2 + T 2 . 

• Step (4) (Recovery using p n [-]): Use p n [t] for t G {i + T 2 - B 2 , . . . , i + T 2 - 1} to recover the 
erased source symbols, (s[i — B 2 ], . . . , s[i — 1]). 

Step (1) (Recovery of p I [-]): Step (1) involves applying code C 3 in computing some missing parity 
checks p J [t]. This is the most elaborate step and is established in the following lemma. 

Lemma 2: The parity check sub-symbols [t] for t E {i+T 2 — B 2 , . . . ,i+Ti — 1} and j e {k, . . . , B 1 — 
1} can be recovered using the parity check symbols p 3 [-] in the interval [i, . . . , i + T 2 — B 2 — 1] (in layer 
(4)) by time t, i.e., with a zero delay. 

Since the proof of Lemma |2] is rather long it is deferred to Appendix. [Ql 

Step (2) (Removal of p 1 [■]): Next we show that the parity check sub-symbols of C 2 in layer (3) are 
free of interference starting at £ 3 = % + B\ — k. This is because the parity check sub-symbols of C\ in the 
interval [i + Bx — k,i + T\ — \] = [t 3 , t 4 — 1] are recovered in Step (1) and those appearing at time i + Ti 
and later are functions of unerased source symbols at times i and later (this follows from the fact that a 
(B,T) SCo code has a memory of T). 

Step (3) (Removal of p 3 [•]): We next claim that the rest of parity check sub-symbols of C 2 in layer (4) 
are also free of interference. In case (A) considered before, this follows immediately from the memory of 
the SCo code. The parity check sub-symbols of C 3 has a memory of T 3 = B\ — k and thus these parity 
checks at time i + Bi — k combine parity check sub- symbols of C\ of time i + B x — k — T 3 + Ti = % + 7\ 
and later (where the addition of T\ is due to the shift back applied on these parity checks). Moreover, 
we have shown in Step (2) that the parity check sub-symbols of C\ at time % + T\ and later combines 
only unerased source symbols from time % and the claim follows. While for case (B), the same argument 
follows in the last q rows. But for the first r{Bx — k) rows of layer (4), the parity checks of C 3 are 
repetition codes. These are either recovered in Step (2) or contain only unerased source symbols. 

Step (4) (Recovery using p n [•]): Step (4) uses the previous two steps to recover the parity check 
sub-symbols of C 2 in layers (3) and (4) starting at p 11 [i + Bi — k] = s[i + B\ — k — T 2 ] — s[i — B 2 ) and 
thus the erased source-symbols can be recovered. 

IX. The Converse For Region (e) (Theorem [5]) 

We want to prove that the capacity is at most 2Ti+B fl B2 _ T2 in the (e)-region defined by the inequalities 
B 2 <T 2 <B 2 + B x and T 2 >T X + B X . 

We start by considering the example {(4, 5) — (7, 10)} illustrating the steps of the converse proof. We 
again use the periodic erasure channel strategy with a period of length 12 and the first 7 of which are 
erased. With 7 erasures, code C 2 = (7, 10) can recover the first two symbols at time and 1 by time 10 
and 11, respectively (c.f. Fig. |9(b)| ). Since code C\ = (4,5) is not capable of recovering the remaining 5 
erasures, we reveal the first of which to the decoder. Now, C\ can recover the source symbols at times 
3 to 6 by times 8 to 11, respectively (i.e., incurring a delay of 5 symbols). Again with the assumption 
of systematic encoding, one can see that a rate of 5/11 upper-bounds the capacity of this channel as 5 
channel symbols where able to decode 6 of the erased source symbols. 

For the general case, the periodic erasure channel to be used is shown in Fig. [TOl where each period 
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1 I * t 

T=10(codeC 2 ) 



(a) Step (1) 



(b) Step (2) 



T=5 (code CJ 



000000000000 000000000000 



(c) Step (3) (d) Step (4) 

Fig. 9. Main steps of finding the upper-bound for the {(4,5) — (7, 10)} point lying in Region (e) through one period illustration of 
the Periodic Erasure Channel. Grey and white squares resemble erased and unerased symbols respectively while hatched squares resemble 
symbols revealed to the receiver. 



has B 2 erasures followed by T x non-erasures. We can assign 

a = T 1 + B 2 -T 2 , b = B 2 -B 1 , c = B 2 , d = B 2 + T x (period length), 



Wi 



id+c 



id+a— 1 
id 



(i+l)<2-l 
id+b 



The idea behind the converse proof is similar to before, but instead we have two decoding functions to 
use. 

We use the decoder of receiver 2 to recover s 



d-i 

c 



We then reveal the channel symbols x 



a-l 




b-1 
a 



within a delay of T 2 using the channel packets 
. The decoder of receiver 1 can now be used to recover 



the next B\ source packets, which are the packets s 



c-l 




d-l 


b 


, using x 


c 



again. In general, we may not 



have a systematic code, so even if x 



source packet s 



d-l 



. Instead, s 



d-l 



d-l 



is received, we may not be able to recover the corresponding 
can be recovered using the second decoder and the first and second 



sets of channel packets that are not erased, i.e. x 



d-l 



and x 



2<2-l 
d+c 



So far, we have recovered (T x + B 2 — T 2 ) + Bi + T\ = 2Ti + Bi + B 2 — T 2 source packets, using 
2T\ channel packets. We do not include the source packets s 6-1 , because it cannot be decoded from 
the information in the unerased channel packets. The channel has a period of B 2 + T\ packets, and if we 
had n periods, then we would be able to recover n(2T x + Bi + B 2 — T 2 ) source packets using [n + l)Ti 
channel packets. Therefore, we can suppose that the upper bound on the multicast streaming capacity is 
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given by 



n ■ (2Ti + B x + B 2 - T 2 ) ■ H(s) < (n + 1) • T x ■ if (x) 

1 2\ 



i2 



if(s) n 

iffxT^ - 



The more formal proof is given below. 
V 



v 1 



2Ti + B X + B 2 -T 2 
Ti 

2Ti + + £ 2 - T 2 



(64) 



Link: 







Fig. 10. The periodic erasure channel used to prove an upper bound on capacity in region (e) indicating which symbols are in groups Wi 
and Vi. Grey and white squares resemble erased and unerased symbols respectively. 



a = Ti + B 2 

A > 



To 



b = B 2 - B x 
< > 



Link: I I I I I I I TT 



c = Bo 



d = B 2 + T x 

Fig. 11. One period of the periodic erasure channel in Fig. [10] with labels. 

Proof: From the (£?i,Ti) decoder, we have for i > 0: 



His 



id+c— 1 
id+b 



From the (B 2 ,T 2 ) decoder, we have for i > 0: 

h(s 

His 

id+c 



id+b-l 




Wi 



id+a— 1 






i<2-l 


id 




X 






id+c— 1 




i+l 



We want to use mathematical induction to prove that for n > 



H(W£) >H{V£- l )+H[W n 
The base case for (|68l) is given by substituting n = into it 

h(w )>h(v - 1 ) + h(w 




0. 



nd—1 




> H(W 



which is obviously true. Let us assume that (1681 ) is true for n = k. This gives: 



H(W£) > Hiy^- 1 ) + H(W, 



kd-l 




(65) 

(66) 
(67) 

(68) 

(69) 



(70) 

We can manipulate the expression in two parts. In the first part, we use W k to recover the source packets 
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[z + 1] 


[z + 2] 


[z + 3] 


[i + 4] 


[z + 5] 




so[»] 




s [i+l] 


s [j+2] 


s [i+3] 


s [i+4] 


s [«+5] 




si[i] 




si[i+l] 


si[i+2] 


ai[i+3] 




n[i+4] 


si[t+5] 


s [i-4] 


so [i— 3] 


s [i-2] 


8o[»— 1] 




«o[»] 


s [i+l] 




>i[i-4] 


8l[»-3] 


si[i-2] 


si[t-l] 




si [i] 


si[i+l] 


g [i- 


6]+si 


[i-5] 


s [i-5]+si[i-4] 


s [i-4]+«i[i-3] 


so[i— 3]+si[i— 2] 


s [i- 


2]+si[i-l 


] so[t— 



TABLE IV 

Mu-SCo Code Construction for (Bi, Ti) = (4, 4) and (B2,T 2 ) = (5, 6). This point achieves the upper-bound given in 

Theorem[6]as Ti = Bi = 4. 



fcd+a— 1 
kd 



and s 



fcci+c-l 



and one can write, 



H(Wg) > H(V k - L s 



kd+a—l 
kd 



kd+c-1 
kd+b 



H[W k 



kd+a—l 
kd 



kd+c-1 
kd+b 



X 



kd+c-1 




(71) 



where the first term on the R.H.S. gives the entropy of the source symbols recovered in previous periods 
Vq~ x as well as the source symbols recovered in this step due to the availability of W k - The second term 
gives the remaining ambiguity in W k to be used in the next step. The detailed steps from (1701 ) to (TTTb is 
shown in Appendix. El 

In the second part, we add H(W k +i\WQ ) to both sides of the inequality. Because the channel code is 
not necessarily systematic, we will use the additional channel packets in W k +i to help decode the source 



packets s 



(fe+l)d-l 
kd+c 



. The corresponding steps provided in Appendix. |E] shows that, 



H(Wq ) > H(Vq) + H[W k+ i 



(fc+l)d— 1 




(72) 



The working in (II 131 ) shows that if (|68l ) is true for n = k, then it is also true for n = k + 1. By 
induction, (|68l ) is true for n > 0. Finally, 



H(W£) > H(V n ~ L ) + H(W n 



71-1, 



nd—1 




>H(V Q 



n-l> 



Using the fact that all of the channel packets have the same entropy, and all of the source packets have 
the same entropy, we can continue to get 



n-l\ 



(n + 1) • T x ■ H(x) > n ■ (2T\ + B x + B 2 - T 2 ) ■ H(s) 



n + 1 



Ti 



n 



Finally, we get 



2Ti + Bt 
R ™ 



Bo — To 



< 



> 



H(s) 
H{x) 

Ti 



To 



as n — > oo 



H{x) ~ 2Ti + B X + B 2 
Therefore, any (B 1 ,T 1 ), (B 2 ,T 2 ) code in the (e)-region must satisfy (|74l) . 

X. Achievability Scheme In Region (f) At Ti = B x (Theorem [6]) 



(73) 



(74) 



We begin with an example of {(4, 4) — (5, 6)} Mu-SCo construction of rate 2/5, as shown in Table ITVl 
A (4, 4) SCo repetition code is then applied resulting in the first two rows of parity checks and then a 
(B 2 — Bi, T 2 — Ti) = (1, 2) SCo is applied and the resulting parity checks are shifted by Ti = 4 forming 
the last row. Note that the first user can recover from any burst erasure of length 4 within a delay of 
4 symbols using the first two rows of parity check sub-symbols. For the second user, assume a burst 
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erasure of length 5 takes place from time i — 5 to i — Notice that user 2 recovers Si[i — 5] and s [i — 5] 
respectively from the last two parity checks at time t — % + 1 i.e., with a delay of T 2 = 6. The rest of the 
erased source symbols are recovered with a delay of Ti = 4 using the repetition code. 

A. Code Construction 

Our proposed code construction, which achieves the minimum delay for user 1 i.e., T\ = B\ is as 
folows 

• Let C\ be the single user (T?i,Ti) = (Ti,Ti) SCo obtained by splitting each source symbol s[i] into 
(T 2 - B x ) = (T 2 - T x ) sub-symbols 

s[i] = (s \i\, . . ■ , ST 2 - Tl -i\i]) 
and repeating them to produce (T 2 — Ti) parity check sub-symbols. 

P 1 ^] = • • • .Pzi-zwI'D = ( s o[* - Ti], . . . , s Ta _ Tl _i[i - Ti]) = s[i - Ti]. (75) 

• Let C 2 be a (£ 2 — -E>i,T 2 — Ti) SCo also obtained by splitting each source symbol s[i] into (T 2 — 
Bi) = (T 2 — Ti) sub-symbols (sq[z\, . . . , st 2 -Ti-i[«]) and then constructing (B 2 — Bi) parity checks 
p u [i] = (PoW) • • • >Pb 2 --Bi-iW) at eacn ^ me combining the source sub-symbols along the main 
diagonal. 

• Concatenate the two streams p 1 ^} and p u [-] after introducing a shift of Ti in the second stream. The 
output symbol at time i is x[i] = (s[i], p ! [«], p n [« — Ti]). 

Since there are T 2 — T x and B 2 — B t parity check sub-symbols for every T 2 — Ti source sub-symbols, 
it follows that the rate of the code is ^ — ^rrrk — — Ct- 

B. Decoding at User 1 

A burst erasure of length Bi can be directly recovered using the stream of parity checks p 1 ^] produced 
by code C\ within a delay of T\. Recall that this immediately follows since the parity checks of the two 
codes are concatenated and not added. 



C. Decoding at User 2 

Suppose that the symbols at time i — B 2 , . . . , i — 1 are erased by the channel of user 2. We first show 
how the receiver can recover s[t] for t E [i — B 2 , i — B± — 1] at time t + T 2 . To recover s[t), the code C 2 
which is a (T 2 —T±,B 2 — B\) code, can be used provided that the corresponding parity checks starting 
at time i — B 1 are available. Due to the forward shift of Ti = B\ applied in our construction, these 
parity checks appear starting at time t = i and are clearly not erased. Secondly for the recovery of s[t] 
we also need the source symbols in the interval [i — B%, t + T 2 — Ti], The C\ repetition code guarantees 
that these are in fact available by time t + T 2 . This shows that all the erased symbols in the interval 
[i — B 2 , i — Bi — 1] can be recovered. The remaining symbols in the interval [i — B 1 , i — are recovered 
using the C\ repetition code. 

XL Upper-Bound For Region (f) (Theorem© 

The converse proof for region (f) is similar to the proof for region (e). We shall use Fig. [T2l and [T3l to 
illustrate the periodic erasure channel used in this proof. Each period, in this case, contains B 2 erasures 
followed by T 2 — B\ non-erasures, for a total of B 2 + T 2 — B\ symbols. 



The first B 2 — B\ source symbols can be recovered with code C 2 , from x 



B2+T2-B1 
b 2 



which are the 



T 2 — Bi unerased channel symbols. We can see that s is recovered at time T 2 , while sbz-b-l-i is recovered 
at time B 2 + T 2 — B\ — 1. Code C\ recovers the next T 2 — Ti source symbols, which is s 2 ~ ^-b 1 
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Link: 



W 



Wi 



Wo 



Fig. 12. The periodic erasure channel used to prove the first upper bound in region (f) showing the locations of the symbols in groups Vi 
and Wi. Grey and white squares resemble erased and unerased symbols respectively. 



Link: 



T 



d 



-> i > 



T2 — X1B2 — Bi T 2 — B\ 
Fig. 13. One period of the periodic erasure channel in Fig. [12] with labels 



We then reveal the remaining channel symbols in the block of B 2 erased symbols, which are the symbols 



x 



b 2 -i 

B 2 -B^+T 2 -T x 



. Finally, code C 2 is used to recover s 



channel symbols, which are x 



B 2 +r 2 -Bi-i 

B 2 



and x 



B2+T2-B1-1 
b 2 

2B 2 +2T 2 -2B 1 -\ 
2B 2 +T 2 -B 1 



, using two sets of T 2 — B\ unerased 



In this one period of B 2 + T 2 — B\ symbols, we have recovered s 



B 2 -B!-l 




B2-B1+T2-T1-I 
B 2 -B! 



and 



B 2 +T 2 -B 1 
B 2 



This is a total of 2(T 2 — Bi) + (B 2 — Ti) source symbols recovered by 2(T 2 — Bi) channel 

symbols. We can extrapolate that n(2(T 2 — Bi) + (B 2 — Ti)) source symbols can be recovered by (n + 
1)(T 2 — Bi) channel symbols. As in region (d) proof, we can suppose that the upper bound on the capacity 
is: 

n(2(T 2 - B 1 ) + (B 2 - rO#(s) < (n + 1)(T 2 - B 1 )H(^) 



His) 



< 



(n + l)(T 2 -B 1 



H(x) ~ n(2(T 2 -B 1 ) + (B 2 -T 1 )) 
T 2 -B 1 



C: 



2{T 2 -B l ) + {B 2 -T l ) 
T 2 -B x 



' f 2(T 2 -B 1 ) + (B 2 -T 1 ] 
For the formal proof, we assign the following: 



(76) 



a = B 2 -B 1 , b = B 2 -B x + T 2 -T x , c = B 2 , d = B 2 + T 2 -B 1 (period length), 



(i+l)d-l 
id+c 



V; 



id+b-l 
id 



(i+l)d-f 
id+c 



From code C\, we have for i > 0: 



His 



id+b-l 
id+a 



X 



id+a— 1 




Wi 



(77) 



2S 



From code C 2 , we have for i > 0: 



H(s 



id+a—l 
id 

id+c 



id-l 




X 



id+c— 1 




W, 1 =0 



We want to show, using mathematical induction, that for n > 



#W) >H(V n ^) + H[W n 
The base case for (|80l) is given by: 



o. 



nd—l 




> ff(W ) 



(78) 
(79) 

(80) 

(81) 



which is true. For the induction step, we assume (l80l is true for n = k, 



n-l\ 



H W n 



(82) 

The second term of the R.H.S. can be used to recover s Ka \ a ^ L and s through codes C 2 and 

Ci, respectively. The corresponding entropy manipulations are provided in Appendix. |F]and the following 
is deduced, 



nd— 1 


and s 



H(W$) > H[V k - L s 



kd+b-l 
kd 



H(W k 



kd+b-l 
kd 



kd+c-1 




(83) 



Next, we add H(W k+ i\WQ) to both sides and show that the newly added W k+ i is capable of recovering 



the source symbols s 



kd+c 



corresponding to W k , 

H(W k+1 )>H(V k ) + H(w k+1 



(fc+l)d-l 




(84) 



The working out of (|84l is provided in Appendix. |F] 

The working in (|8~3l and (|84|) shows that if (|8Q|) is true for n = k, then it is true for n — k + 1. By 
induction, (|8Q|) is true for n > 0. Therefore, 



H W„ 



nd—l 




>H(V C 



We can use the fact that the source symbols have the same entropy and the same for channel symbols to 
obtain: 

H{W?) > H{Vr l ) 



(n + 1) • (T 2 - B 1 ) ■ F(x) > n ■ (2(T 2 - S x ) + (B 2 - T x )) • H(s) 



In other words, 



His) 
R = < 



T 2 -B 1 



H(x) ~ 2(T 2 -B l ) + (B 2 ~T 1 
Therefore, (|86l governs any {(B 1 ,T 1 ), (B 2 ,T 2 )} code in the (f)-region 



. (as n — > oo) 



(85) 
(86) 



XII. Code Construction For Region (f) At T 2 = B 2 (Theorem [7]) 



We simply use a concatenation of two codes — one for user 1 and one for user 2. In particular, we 
divide each source symbol into 7\ sub-symbols, apply a (B 1 ,Ti) SCo to get B x parity check sub-symbols, 
apply the (T 2 , T 2 ) SCo which is just a repetition code resulting in T x parity check sub-symbols and finally 
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L J 


[z + 2] 


[l + 3] 


[i + 4] 


[z + 5] 




so[»] 






s [i+2] 


s [i+3] 


s [i+4] 


s [«+5] 




si [i] 




si[i+l] 


si [i+2l 

^ J. 1 1 J 


si \i+3] 




n[i+4] 


si fi+5l 




s 2 [i] 




Ort [9*4-1 1 


so — i-2i 






i 2 [i+4] 




s [i- 


3]+s 2 [i-l] 


<?n[?' — 2l4-9o[?'l 






So[i+l]+S 2 


[i+3] 


«Sn [7*4-21 4- So [?' 4-4-1 


81 [i- 


3]+s 2 [i-2] 


si[i-2]+s 2 [i-l] 


si[i-l]+S2[i] 


si[i]+s 2 [i+l] 


si[i+l]+s 2 


[t+2] 


si[i+2]+S2[«+3] 


s [i-4] 


s [i-3] 


s [i-2] 


s [i-l] 




soM 




s [t+l] 


*i[»-4] 


si[i-3] 


si[i-2] 


8i[i-l] 




si [i] 




Sl[l+1] 


s 2 [i-4] 


s 2 [i-3] 


s 2 [i-2] 


8 2 [i-l] 




s 2 [i] 




82 [i+1] 



TABLE V 

Mu-SCo Code Construction for (Bi,Ti) = (2, 3) and (_B 2 , T 2 ) = (4, 4). The rate of 3/8 of such Mu-SCo is the capacity 

given in Theorem[7]for T 2 = B 2 case in region (f). 



concatenate them to have Bi + T x parity check sub-symbols for each T\ source sub-symbol (i.e., a rate 



of 



2Ti+Bi 



C 



f(T 2 =B 2 



))• 



Consider the example of {(2, 3) — (4, 4)} code in Table IVl Each source symbols is divided into T% = 3 
sub-symbols. A (Bi, T\) = (2, 3) SCo is applied to generate the first two rows of parity check sub-symbols 
which are concatenated to three more rows of parity check sub-symbols generated by the (B 2 , T 2 ) = (4, 4) 
repetition code. User 1 and 2 can recover from bursts of length 2 and 4 within delays of 3 and 4 respectively 
by considering the corresponding rows of parity checks while neglecting the other rows. 

XIII. The Converse For Region (f) At T 2 = B 2 (Theorem [7]) 

The converse for Theorem [7] depends on double recovery of some source symbols, once using code C\ 
and another using C 2 . We illustrate the main idea of such converse through considering the specific point 
{(2, 3) — (4, 4)} shown in Fig. [14] We start by considering a periodic erasure channel with period length 7. 
The first 4 symbols are erased while the rest are unerased. With 4 erasures, code C 2 = (4, 4) can recover 
the first two symbols at time and 1 by time 4 and 5, respectively. We note that the channel symbol at 
time i is sufficient to recover the source symbol at time i — 4 (i.e., no more channel symbols are required). 
In step (3) in Fig. [14] gives the main idea of this converse. Since, there are two remaining erasures, the 
source symbol at time 2 can be recovered using C\ = (2, 3) within a delay of 3 (i.e., by time 5). Also, the 
same source symbol can be decoded using C 2 by time 6 (double recovery). The remaining erasure can be 
recovered using C\ by time 6. Moreover, the repetition code C 2 = (4,4) can recover the source symbols 
at time 4, 5 and 6 from their corresponding channel symbols. Therefore, the three channel symbols are 
capable of recovering a total of 8 source symbols (symbol at time 2 is recovered twice) which implies 
that a rate of 3/8 is an upper-bound. 

For the general case, the corresponding periodic erasure channel to be used for proving the upper-bound 
is given in Figure [15] Each period has B 2 erasures followed by T\ non-erasures. 

It so happens that the B 2 = T 2 restriction means that we can prove the converse by only analyzing 
one period. The reason will be made clear later. But this simplifies the proof and allows us to study the 
technique of double counting source packets more easily. 

In Figure \T6[ we have the first period of the erasure channel. The key is to show that the received 

D IT -1 1 

channel packets x 2 B 1 alone can recover all of the source packets in the period, but there is enough 
information in the channel packets to recover some of the source packets twice. The fact that we have 
two decoders allows some of the source packets to be decoded by mutually exclusive groups of channel 
packets, but when we put all of the channel packets together, the redundant information in the channel 
packets does affect the maximum achievable rate of the code. 



b 2 +Ti-i 

B 2 



are s 



The source packets that can be recovered by x 
Figure [16] shows, the first two groups of source packets overlap. The overlap consists of the packets 



2i-l 



B 2 -l 
B 2 -B x 



and 



B2+T1- 

B 2 



As 



00000 



T=4 (code C 2 ) 
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00000 
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(a) Step (1) 



(b) Step (2) 



T=3 (code C x ) 

I \ 

0000000 
I t 

T=4 (code C 2 ) 



T=3 (code C x ) 



I } 

0000000 



(c) Step (3) (d) Step (4) 

Fig. 14. Main steps of finding the upper-bound for the {(2,3) — (4,4)} point lying in Region (f) through one period illustration of the 
Periodic Erasure Channel. Grey and white squares resemble erased and unerased symbols respectively. 
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Link: 



Fig. 15. The periodic erasure channel used to prove an upper bound on capacity in region (f) for the special case T2 = Bi. 



T x -\ 
B 2 -B 1 



. The reason why we can use a single period in the proof is because the B 2 = T 2 constraint 



B2+T1-1 

B 2 



using only the packets x 



B2+T1-1 

B 2 



and 



allows us to decode the final group of source packets s 
does not require any future channel packets. 

Assuming that what we have just described is possible, then we have T x channel packets recovered 



B l 

i > <- 



Tl 



Link: 
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Bn 



Fig. 16. One period of the periodic erasure channel in Fig. [15] with labels. 
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2Ti + Bi source packets. We should be able to write the relation: 

(2Ti + Si) ■ H(s) < Ti ■ tf(x) 



fl"(s) 
i2 = -=-4- < 



7i 



#(x) - 2Ti + Bi 

The formal proof shows that this is indeed possible. 

Proof: We can split the proof into three major parts. 

can be recovered from the channel packets x 



1 . The source packets s 



Ti-Bi-l 




(B 2} B 2 ) decoder, so we can write 



Ba+Ti-Bi-l 
B 2 



His 







B 2 +T x -Bx-\ 
B 2 



(87) 

using the 
(88) 



Next, we can write 
H(x. 



B 2 +T 1 -B 1 -l 
B 2 



His 



= h(s 
> h(s 



Ti- 


-Bi-1 



X 


Ba+Ti-Bi-l 
B 2 




-Bi-1 



X 


"B 2 +Ti-Bi-l" 
B 2 



His 



Ti-Bi-l 


Ti-Bi-1 




H(x 
h(x 



B3+T1-B1-I 
B 2 

B2+T1-B1-I 
B 2 



Il-Bi-l 




Ti-Bi-1 


Ti-Bi-1 




Ba+Ti-Bi-l 
B 2 



Ti-Bi-1 




We used (1881) to remove the negative term before step (a). 

2. In this step, we want to prove the following inequality for m > B 2 + T\ — B\ — 1: 



(89) 



i=B 2 



m—B 2 




+ H[s 



m-Ti 
B 2 -B x 



H x 



m 






m—B 2 




m-Ti 




B 2 




S 





S 


Ba-Bj 


X 



m—B 2 




Using the first decoder with a (£?i,Ti) property, we can write the following relation: 



i-Ti+Bi 



i-Ti-1 




0. 



Using the (B 2 , B 2 ) decoder, we can write the following relation: 



H[s[i - B 2 \ x[z]x 
which can be used in the following steps 



i-Ba-l 




HUH] 



i-B 2 -l 




H sU-BM] 



(a) 



H[s[i-B 2 ]x[{\ 



i-B 2 -l 


i-B 2 -l 




H sU-Bo 



XIX 



i-Ba-l 




H{s[i- B 2 ]) + Hht\i] 



s\i - Solx 



i-Ba-l 




Therefore, 



H(x.[i]) > H(s[i - B 2 \) +ff(x[i]|s[i - Sajxf*-^]) 



(90) 



(91) 



(92) 



(93) 



The second decoder (|92l) was used to remove the negative term before step (a). 

Now we can use mathematical induction to prove (|90b - For the base case, we substitute m = B 2 + T X 
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B x -\ 



H(^)>h(s 

i=B 2 



Tx-Bi-1 




+ H[a 



Ba--Bi 



+ #(x 



"Sa+Ti-Bx-l" 










"B2-B1-1" 




Ti-Bx-l" 
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B 2 
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B2-B1 
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T1-B1-I 




#(x 



B2+T1-B1-1 

B 2 



Tl-Bi-l 








This is proved by the result of (|89l ). 

Assume that (|90l ) is true for m = j, which gives us 



(94) 



£ff(xH)>ff(s 
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+ if s 



j-Ti 
B2-B1 



+ #X 









j'-Ba 








J-Ba 


B 2 




s 





s 


B2-B1 


X 






(95) 



We add H(x[j + 1]) to both sides, and use (l9TT) and (l92l ) to recover the source symbols s[j + 1 — B 2 ) and 
s[j + 1 — Ti] respectively giving: 



j+l-Ba 




if S 



B 2 -Bi 



Fx 



j+1 
B 2 



J+l-Ba 




B2-B1 



i+l-Ba 




• (96) 



f>(x[z])>tf(s 

i=B 2 

The corresponding detailed steps are provided in Appendix. [Gj By induction, we have proved (|90l ) for 
m > S 2 + 2i - Si - 1. 

3. We substitute m = B 2 + T x - 1 into (l90l) 



B2+T1-1 
£ F(x[i])>tf(s 

i=B 2 



Ti-1 



F s 



B 2 -l 
B 2 -Bi 



#(x 



Ba+Tx-l 
B 2 



r, -1 



B 2 -l 
B 2 -Bi 



Ti-1 



(97) 



We can recover s 
2, so we can write 



Ba+Ti-l 
B 2 



from x 



B2+T1-1 

B 2 



His 



given the previous channel symbols x 
0. 



b 2 -i 




' B2+TI-1 






"B2+T1-I" 




B 2 
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) 



Using (1981 ), we continue with (1971) to get (c.f. Appendix. 

B2+T1-1 

i=B 2 



His 



B2+T1-1 

B 2 -Bj 



using decoder 
(98) 

(99) 



Finally, we use the fact that all source symbols have the same entropy and all channel symbols have 
the same entropy to write, 



B2+T1-1 



52 F(x[i])>iJs 



i=B 2 



Ti-1 




His 



B2+T1-1 

B 2 -Bj 



Ti • Jf (x) > (2Ti + Bi) • H{s) 
Ti 



R = -^-4 < 



tf(x " 27\ + Si 



(100) 



which is the proper upper bound. 



XIV. Conclusion 

We study a multicast extension of the low-delay codes for streaming over burst erasure channels. 
The proposed setup has several interesting implications. From a capacity point of view, we observe an 
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interesting interplay between the delay of the two receivers. In particular, in the large delay regime we 
characterize the capacity and observe a surprising delay- slackness property i.e., for most parameters, the 
delay of one of the receivers can be reduced up to a certain critical value without reducing the capacity. 
In the low-delay regime the capacity has only been partially characterized. New code constructions are 
developed for various regimes. Our constructions generate parity checks in multiple layers and carefully 
combine them to meet the require decoding constraints. 

Our ongoing work involves further investigating the capacity in the low-delay regime. Furthermore the 
results in this work are a step towards developing robust streaming code constructions, which can be used 
in time-varying channel conditions where the burst-length cannot be determined apriori. 



Appendix A 
Proof Of ([24]) and dSJ 

The steps to get the result in (|24l is as follows: Using (|24l) we have that 
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k(B+T)-l 




(101) 



This can be further simplified as follows. 
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(102) 



Step (a) uses the joint entropy expansion formula, step (b) uses (1191) to remove the negative term and 
step (c) is a joint entropy expansion. Step (d) uses the fact that source packets are independent of each 

must be independent of the past channel packets 



other, so therefore the source packets s 
x 



k(B+T)+B-l 
k(B+T) 



fc(B+T)-l 




Step (e) joins the first two terms from (d), and also uses the fact that conditioning reduces 
entropy in the last term and the result in (l24l follows. 

To get the result in (|25T) . we start by adding H(W k+ i\W$) to both sides of (O to get, 
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where R = V fc x s fc(B fc |J^f 1 x fc ( B+T H B 1 . Step (a) introduces extra conditions in the final term, 
so entropy is reduced, step (b) uses the joint entropy formula, step (c) uses the joint entropy expansion 
formula and step (d) uses (|20l) to remove the negative term in (c). Step (e) uses the joint entropy formula 
again to expand the second term of (d) and step (f) uses the fact that source packets are independent of 
previous channel packets. Step (g) once again uses the joint entropy formula and (|25T ) follows. 



Appendix B 
Proof of (031) and (1461) 



The working out of (|45l) is as follows 
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We use (1401) to remove the negative term before step (a). Similarly, we remove the negative term before 
step (c) using (|4T|) . Steps (b) and (d) use the fact that source packets are independent of each other and 
of previous channel packets. 
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While for (1461 we start by adding H(W k+1 \ W^) to both sides of (g5]) to get, 
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Step (e) follows by the fact that conditioning reduces entropy knowing that Wq 1 C x 
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and thus 
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< H{Wk+i\Wk), and again we remove the negative term before step 



(f) using (I41j) . Step (g) uses the fact that source packets are independent of each other and (|461 ) follows 



Appendix C 

Examples of Code Construction in the (e) Region 

We give the construction for two specific points in this region, Table IVll shows the code construction for 
the point {(4, 5) — (7, 10)} whereas Table rvTTl shows the code construction for the point {(3, 5) — (7, 9)}|. 
In both cases k = 1 and m = 1. The former satisfies T\ < 2{B X — k) whereas the latter satisfies 
Ti > 2(B 1 - k). 



A. Example (1): {(4, 5) - (7, 10)} k = 1, m = 1 



The code construction achieving the optimal rate of 5/11 is illustrated in Table IVO In this example, 
we walk through the steps of both the encoder and the decoder. We note that this point resembles case 
(A) defined by 7\ < 2{B X — k) in the general code construction given in Section. IVIII1 

• Encoder 

- Each source symbol is divided into T\ = 5 sub-symbols (s [], ■ ■ ■ , s 4 [.]). A C\ = (4, 5) is applied 
along the diagonal of such source sub-symbols producing B\ = 4 parity check sub-symbols 
(po[.), . . . ,p 3 [.]) defined as follows, 

Po[i] = s [i - 5] + s 4 [i - 1] 
Pi[i] = si[i - 5] + Si[i - 2] 
p 2 [i] = s 2 [i - 5] + Si[i - 3] 

p 3 [i]=s 3 [i-5]+s$-4] (106) 
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TABLE VI 

Rate 5/11 Mu-SCo Code Construction for the point, (Bi, Ti) = (4, 5) and (S 2 ,T 2 ) = (7, 10) lying in region (e). This 

POINT IS ALSO ILLUSTRATING CASE (A) DEFINED BY T\ < 2{Bi - k) . FOR THE CAUSAL PART OF PARITY CHECK SUB-SYMBOLS OF Ci 
SHIFTED BACK TO TIME i — t , WE WRITE pj [i] INSTEAD OF pj [i] | FOR SIMPLICITY. 



- Then, the T\ — 5 parity check-symbols of code C 2 = (10, 10) which are repetitions of the source 
sub-symbols such that pfli] = Sj[i — 10] for j E {0, . . . , 4} are concatenated to the parity checks 
of C\ with partial overlap of B% — k = 3 rows as shown in Table [Vlj 

- A C 3 = (Ti - (fii - k),B 1 - k) = (2, 3) SCo code is applied on the last B 1 - k = 3 rows 
of parity check sub-symbols of C\, (pi[.],p 2 [-],P3[-]) producing Ti — — k) = 2 parity check 
sub- symbols, (Pot-LPit-D- The produced parity checks is shifted back by T t = 5 and combined 
with the last two rows of parity check sub-symbols of C 2 - 

We note that applying a shift back of T\ = 5 on the parity check sub- symbols of C 3 explains why 
Pq[i] = pi[i + 2]+p 3 [i+4:] appears at time i and not z + 5. Moreover, since px[z + 2] +p 3 [i+4] in general 
combines source sub-symbols at time i + 3 and earlier, they can not appear at time i as this violates 
the causality of the code construction. Thus, the causal part of such parity checks shifted to any time 
instant t (denoted by Pj[.] L) is to be sent instead. For example, the first parity check sub-symbol of 
C 3 at time i is p% [i + 5] = pi [i + 2] + p 3 [i + 4] = si[i — 3] + s 4 [i + 1] + s 3 [i — 1] + s 4 [i] . The causal part 
of this parity check is sent instead, i.e., pl[i + 5]| . = pi[i + 2]| . +p 3 [i + 4] | . = si[i — 3] + s 3 [i — 1]. 
According to Fig. [8] we divide each channel packet into four layers, 

- Layer (1) contains the first five rows which are the source sub-symbols. 

- Layer (2) contains the next row. 

- Layer (3) contains the next three rows where overlap between the parity checks of codes C\ and 
C 2 takes place. 

- Layer (4) contains the last two rows. The overlap between the parity checks of codes C 2 and C 3 
takes place. 

• Decoder 

With a burst erasure of length B 1 = 4 taking place at times [i — 4, % — 1], the decoder at user 1 
simply uses the first four rows of parity checks at times [i, i + 4] after subtracting the unerased source 
sub-symbols so[t], si[t], s 2 [t] for t £ {i — 10, . . . , i — 6}. For user 2, we assume a burst erasure of 
length B 2 = 7 at times [i — 7, % — 1]. The decoding steps are as follows. 

- Step (1): Recover pj[i + 3] and Pj[i + 4] for j = {1, 2, 3}. 
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(a) In layer (3), spanning the second, third and fourth rows of parity checks, one can see that 
the parity check sub-symbols of C 2 in the interval [i,i + 2] are unerased source sub-symbols. 
Thus, the corresponding combined parity check sub-symbols of C\ can be computed in this 
interval. 

(b) In the same layer but in the interval [i + 5, oo), the parity check sub-symbols of C\ are of 
indices i + 5 and later. Using the fact that (Bi,Ti) SCo code has a memory of 7\ symbols, it 
can be easily shown that these parity check sub- symbols combine only source sub- symbols 
of time i and later which are not erased and thus can be computed as well (c.f. (|106l) ). 

(c) Steps (a) and (b) show that all the parity check sub-symbols of C\ in layer (3) can be 
computed except for the interval [i + 3, i + 4]. 

(d) The parity check sub-symbols of C 2 in layer (4) spanning the last two rows of parity check 
sub- symbols in the interval [i, % + 2] are again unerased source sub- symbols and thus can 
be cancelled and the corresponding parity check sub-symbols of C 3 can be computed in this 
interval. 

(e) The parity-check sub-symbols of C 3 in the interval [i,i + 2], 

(p 3 [i + 5}\. pjj[i + 6]|. +1 pg[i + 7] 
\pl[i + 5}\. p?[z + 6]|. +1 p\[i + 7] 

can recover the remaining two columns of parity-check sub- symbols of C\ in the interval 
[i + 3, i + 4] lying in layer (3), 

Pi[i + 3] pi[i + 4] \ 
p 2 [* + 3] p 2 [* + 4] , 
p 3 [* + 3] p?\i + A} J 

since C 3 is a (2, 3) SCo code whose parity-check sub-symbols are shifted back by T\ =5. 
However, only the causal part of the parity checks of C 3 are available. Thus, the non-causal 
part is to be computed and added to the causal-part to recover the original parity checks of 
the SCo code. Using (11061) , it can be seen that the recovery of the non-causal part does not 
require the availability of source sub-symbols after time^l % + 3. For example, p§ [i + 5] I . = 
Pl [i+2}+p 3 [i+A} = si[i-3]+S4[z]+s 3 [z-l]+s 4 [z],while^[z+5]|. =pi[i+2]|.+p 3 [«+4]f 4 = 
si[i — 3] + s 3 [z — 1], i.e., the non-causal part of pl[i + 5] . is pl[i + 5]|. = 2s 4 [i] which is 
clearly available before time i + 3. Thus the non-causal portions of all the parity checks are 
computed and then (11071) is applied. 

- Step (2): After recovering these parity check sub- symbols, the decoder can cancel their effect in 
the second, third and fourth rows of parity checks (layer (3)) at times i + 3 and i + 4. Moreover, 
in the same rows and starting at time i + 5 all parity checks of code C\ combine only unerased 
source symbols (c.f. (11061 )') and thus can be cancelled as well. 

- Step (3): Furthermore, one can see that the parity check sub-symbols of C 3 interfering in the 
last two rows (layer (4)) starting at time i + 3 combine parity check sub-symbols of C\ of indices 
i + 5 and later which was shown before to combine unerased source sub-symbols (c.f. (11061) ). 

According to Step (2) and (3), the parity checks of C 2 = (10, 10) repetition code in layers (3) 
and (4) are now free of any interference from i + 3 and later. Thus, the decoder of user 2 is 
capable of recovering the erased source sub-symbols in the interval [i — 7,i— 1]. 
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TABLE VII 

Rate 5/11 Mu-SCo Code Construction for the point, (Bi, T\) = (3,5) and (B 2 ,T 2 ) = (7, 9) lying in region (e). This point 

IS ALSO ILLUSTRATING CASE (B) DEFINED BY T\ > 2(Bi — k). FOR THE CAUSAL PART OF PARITY CHECK SUB-SYMBOLS OF Ci 
SHIFTED BACK TO TIME i - t, WE WRITE pj [i] INSTEAD OFpj[i]| FOR SIMPLICITY. 



B. Example (2): {(3, 5) - (7, 9)} => k = 1, m = 1 

Again the capacity equals 5/11. The code construction achieving such rate is illustrated in Table rvTTl 
The reason we give the detailed encoding and decoding steps for one more example is to show the main 
differences between case (A): T\ < 2{B\ — k) illustrated by the previous example {(4,5) — (7, 10)} and 
case (B): T x > 2(Bi - k) illustrated by this example, {(3, 5) - (7, 9)}. 

• Encoder 

- Each source symbol is divided into T\ = 5 sub-symbols (sq[.], . . . , s^[.]) (layer (1)). A C\ — (3, 5) 
is applied along the diagonal of such source sub-symbols producing £>i = 3 parity check sub- 
symbols (po[-Lpi[-Lp2[-D defined as follows, 

Po[i] = s [i - 5] + s 3 [i - 2] 
Pl [i] = Sl [i - 5] + s 4 [i - 2] 

p 2 [i\ = s 2 [i - 5] + s 3 [i - 4] + s 4 {i - 3] (108) 

- Then, the T\ — 5 parity check-symbols of code C 2 = (9, 9) which are repetitions of the 
corresponding source sub-symbols are concatenated to the parity checks of C\ with partial overlap 
of Bi — k = 2 rows as shown in Table IVII1 

- Since T x = 5 > 4 = 2{B X — k), this point falls in case (B), one can write T x — (B x — k) = 
r(B x — k) + q as 3 = 1(2) + 1, i.e., r = 1 and q = 1. Thus, r + 1 = 2 SCo codes are to be 
constructed. The first is a repetition code of parameters Cz,i = (B x — k, B\ — k) = (2, 2) is 
applied on the last B x — k = 2 rows of parity check sub-symbols of C\, (pi[.],p 2 [-D producing 
(Bi — k) = 2 parity check sub-symbols, (pjj [-],£>?[•]) which are then shifted back by 2(B 1 — k) = 4 
symbols, while the second is a £3,2 = (q, B x — k) = (1, 2) SCo code applied again on the last two 
rows of parity check sub-symbols of C\ along the main diagonal producing one row of parity 
check sub- symbols, which is shifted back by T x = 5 symbols. The parity check sub- symbols 
of C 3 i and C 3 2 (denoted by C 3 ) are then concatenated forming T x — (B x — k) = 3 rows of parity 
check sub-symbols and then combined with the last three rows of parity check sub-symbols of 

3 A proof of this in the general case is provided in the proof of Lemma [2] in Appendix |Pl 
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C 2 (layer (3)). 

The same causality argument stated in the previous example applies and the causal parts of the 
corresponding parity check sub-symbols shifted to any time instant t denoted by Pj[-]\ t are sent 
instead (c.f. Table ED). 

Similar to the previous example, we divide each channel packet into four layers (c.f. Fig. [8]), 

- Layer (1) contains the first five rows which are the source sub- symbols. 

- Layer (2) contains the next row. 

- Layer (3) contains the next two rows where overlap between the parity checks of codes C\ and 
C 2 takes place. 

- Layer (4) contains the last three rows. The overlap between the parity checks of codes C 2 and 
C 3 takes place. 

Decoding: 

For user 1, the decoding is similar to the previous example. We assume a burst erasure of length 
Bi = 3 taking place at times [i — 3,i — 1]. One can recover the parity checks of code C\ in the 
first three rows of parity checks at times [i, i + 4] after subtracting the unerased combined source 
sub-symbols s [t), S\[t\, s 2 [t) for t E {i — 9, . . . , i — 5}. For user 2, we assume a burst erasure of 
length B 2 = 7 in the interval [i — 7, i — 1], The decoding steps are as follows. 

- Recover pj[i + 2], Pj[i + 3] and pj[i + 4] for j = {1,2}. 

(a) In layer (3), spanning the second and third rows of parity checks, one can see that the parity 
check sub-symbols of C 2 in the interval [i, i + l] are unerased source sub-symbols. Thus, the 
overlapping parity check sub-symbols of C\ can be computed in this interval. 

(b) In the same layer but in the interval [i + 5, 00), the parity check sub-symbols of C\ are of 
indices i + 5 and later. Using the fact that (Bi,T{) SCo code has a memory of T\ symbols, it 
can be easily shown that these parity check sub- symbols combine only source sub- symbols 
of time i and later which are not erased and thus can be computed as well(c.f. (11081) ). 

(c) In steps (a) and (b), we show that all the parity check sub-symbols of C\ in layer (3) can 
be computed except for the interval [i + 2, i + 4]. Let us mark the uncomputed parity check 
sub-symbols as erased source sub-symbols with two rows and three columns. 

(d) Moreover, the parity check sub-symbols of C 2 in layer (4) spanning the last three rows of 
parity check sub-symbols in the interval [i, i + l] are again unerased source sub-symbols and 
thus can be cancelled and the corresponding parity check sub-symbols of C 3 can be computed 
in this interval. 

(e) C 3 is a concatenation of C 3j i = (2, 2) repetition code producing two parity-check sub-symbols 
(Po[-]>Pi[-D an d a ^3,2 = (1,2) SCo code producing a single parity-check sub-symbol p\[]. 
At time i and i + l, the parity checks of C3 1, 



pl\i] 



Pi[i + 2] 
P2[i + 2] 



thus, pi[i + 2] . and p 2 [i + 2]| can be directly recovered, while their corresponding non- 
causal parts can be computed before time i + 2. Similarly, px[i + 3] | . and p 2 [i + 3] | . can be 
recovered at time i + l and their corresponding non-causal parts can be retrieved before i + 3. 
The remaining column, (fti[i + 4] | .,p 2 [i + 4] \.) T can be recovered using the parity checks of 
£3,2 = (1) 2) SCo code at time i and i + l, p 2 [i] and p\\i + 1} in a similar way used in the 
previous example. 

After recovering these parity check sub-symbols of C%, the decoder can cancel their effect in the 
second and third rows of parity checks (layer (3)) at times i + 2, i + 3 and i + 4. Moreover, in 
the same rows and starting at time i + 5 all parity checks of code C\ combine only unerased 
source symbols (c.f. (11081 )) and thus can be cancelled as well. 
Remove interference in layer (4) starting at time i + 2. 
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i+T, 




Fig. 17. Diagonal Embedding of parity checks for the construction in section FVIIII The parity checks p i [-] are applied using a (T3, B3 
SCo code onto the last Bi — k parity checks of in layer 3. The parity checks p 3 [-] are shifted back by Ti units as discussed before. 



The parity check sub-symbols of C 3 interfering in the last two rows (layer (4)) starting at time 
i + 2 are of indices i + 4 and later which are either recovered in Step (1) or can be calculated 
as they combine unerased source sub-symbols (c.f. ([[08])). 
Use the parity-checks in layer (3) and (4) to recover s[i — 7], . . . , s[z — 1]. 

According to Step (3) and (4), the parity checks of C 2 in layers (3) and (4) are now free of any 
interference starting at time i + 2 and thus, the decoder of user 2 is capable of recovering the 
erased source sub- symbols. 



Appendix D 
Proof of Lemma. [2] 

The parity-check sub-symbols of C 2 in the interval [t 2 ,t 3 — 1] = — B 2 + T 2 — 1] are source sub- 
symbols in the interval \t 2 — T 2 , t 3 — T 2 — 1] = [i — T 2 , i — B 2 — 1] which are not erased. Thus, they can 
be computed and subtracted to recover the combined parity-check sub-symbols of C\ and the causal part 
of that of C3 in layers (3) and (4), respectively. More specifically, the parity-check sub-symbols p 1 , [•] for 
ji G {k, . . . , Bi — 1} and p^ 2 [•] for j 2 e {0, . . . , B 3 — 1} are recovered. 

Recall that C3 is a (B 3 ,T 3 ) is a SCo code applied by taking the last B\ — k parity check sub-symbols 
of C\ as source sub-symbols. 

Let us define the parity-check symbols that need to be recovered as 

w[t] = (w [t\, . . . ,w Ta -i[t]) = (p\[t], . . • ,p l Bl -i[t}). (109) 
We first consider case (A) i.e., when T\ < 2{B\ — k). Since C3 is an SCo which involves diagonal 
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interleaving of Low Delay - Burst Erasure Block Codes (LD-BEBC), the diagonals that span the sub- 
symbols of interest are as follows: 

d r = (wo[i + r], . . . , w Ts -i[i + r + T 3 - l],p 3 [i + r + T 3 ], . . . ^^[i + r + T 3 + B 3 - 1]), 

rel T 3 + 5 3 -l (HO) 

Since the parity check sub-symbols of C 3 are shifted back by Ti = T 3 + B 3 keeping only their causal 
part, the corresponding diagonals of interest are 

d r = (w [i + r},...,w T3 „i[i + r + T 3 - + r + T 3 ] \ i+r _ Ba , 

■■■iPk-Ai + r + n + Bz-l}].^). (Ill) 

where recall that Pj[ti]| t denotes the causal part of the parity check Pj[t%] w.r.t. £ 2 (c.f. (1571)). 

With every parity check sub-symbol projected to a different time instant, one can clearly see that d r is 
no more a code-word of an LD-BEBC code. 

The following conditions are sufficient to establish Lemma. [21 
cl The diagonals d r for r £ {1, . . . , T 3 + B 3 — 1} span all the parity-check sub-symbols that need to be 

recovered, i.e., for j £ {k, . . . , B x — 1} in the interval [t 3 , i 4 — 1] = [z + T 2 — £ 2 , i + T\ — 1]. 
c2 The decoder can compute the non-causal part of each parity -check in the interval [i 2 , £3 — 1] and 
reduce (II 111 ) to (111 Ob ■ This step should not violate the zero-delay constraint for any erased symbol on 
the diagonal i.e. the non-causal part of the parity-check sub-symbol p| [t x \ responsible for the recovery 
of a given parity check Wj 2 [t y ] should combine source sub-symbols s[.] which are both, not erased 
and from time earlier than t y . 
c3 Each diagonal d r should have no more than B 3 erased sub- symbols. 

For cl, we note that the diagonal d x covers wt 3 -i[i+T 3 ] = P^-iii+^V] which is the lower left most sub- 
symbol that needs to be recovered. At r = T 3 +B 3 — 1, one can see that d r combines w [i + T 3 + B 3 — 1] = 
p\[i + T 3 + B 3 — 1] which is the upper right most sub-symbol that needs to be recovered. Fig. [T71 easily 
illustrates that the diagonal d r for r £ [1,T 3 + B 3 — 1] cover all of the erased sub-symbols. 

For c2, we note that all elements of a diagonal d r combine source symbols s[-] from time i + r — 1 
and earlier according to the diagonal interleaving property of SCo codes. Thus, one can conclude that the 
non-causal part of any parity-check sub-symbol p 3 Ai + r + T 3 + j] I . for j £ 0, . . . , B 3 — 1 in d r is 

just a combination of source symbols in the interval [i + r — B 3 +j, i + r — lj. Thus the entire non-causal 
part of each parity check is available before time i + r and the reduction to (II 101 ) is possible for each d r . 

Finally note that the zero delay constraint also requires that the symbols Wj [t] with t > i + T\ in d r be 
made available before time t = i + r. Since each Wj[t] for t > i + T\ only consists of combinations of 
source symbols in [i, i + r — 1] these symbols can be explicitly computed by the decoder by time i + r — 1 
and c2 follows. 

For c3, we divide the values of r into three intervals. 
. d r forr £ {1,...,^-^} 
In this range, one can see that the following symbols are available, 

(w [i + r], . . . , w T3 _ r _![i + T 3 - l),p% 3 _ r [i + T 3 + B 3 ], . . . ,^| 3 _ 1 [i + r + T 3 + B 3 - 1]), 

which are a total of T 3 sub- symbols in the beginning and the end of the diagonals d r which contains 
T 3 + B 3 sub-symbols. In other words, each such diagonal has B 3 erased sub-symbols happening in 
a burst. 

. d r forr £ {Tx-Tg + l,...,^} 
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In these diagonals, the following symbols are available, 

(w [i + r], . . .,w T3 -r-i[i + T 3 - l),w Tl - r [i + Ti], . . . ,w T3 -i[i + r + T 3 - l],pl[i + r + T 3 ] 

,...,^3_i[i + r + r 3 + B3-l]), 

The first group is a total of T 3 — r consecutive sub-symbols, while the other two groups are a total 
of r consecutive sub-symbols. This implies that each such diagonal d r has B 3 erased sub-symbols 
in a burst. 
. d r forr G {T 3 + 1,...,T 3 + B 3 -1} 
The available sub-symbols in these diagonals are, 

(w Tl . r {i + Tx], . . . , w T3 ^[i + r + T 3 - l],f [i + r + T 3 ], . . . , p^^i + 2T 3 + B 3 - 1]), 

which are again a total of T 3 consecutive sub- symbols which implies that the considered diagonals d r 
has B 3 erased sub-symbols in a burst and the c3 follows. We note that LD-BEBC codes are capable 
of recovering wrap-around burst which may start at the end of the block and wrap around to the 
beginning of that block. 

When Ti > 2(Bi — k) note that C 3 is a concatenation of r + 1 codes, the first r of which are repetition 
codes with parity check sub-symbols given by (|6T| ). These parity-check sub-symbols in the interval [i, i + 
(Bi — k) — 1] can be used to recover the causal part of the parity-check sub-symbols (p fe [ti], • • • >Fbi-i[*i]) 
for ti G {i + (Bi - k), . . . , i + (r + l)(Bi - k) - 1} = {i + T 2 - B 2 , . . . , i + T x - q - 1}. The non-causal 
part of these parity-check sub-symbols combine source sub-symbols in the interval [i,ti — 1] which are 
not erased and thus can be recovered. 

The remaining q columns of parity-check sub-symbols (pjt^], • • • jPsi-ife]) for h £ {i + (r + l)(Bi — 
k), . . . ,i + (r + l)(Bi — k) + q — 1} = {% + T\ — q, . . . , i + T\ — 1} can be recovered using the parity- 
check sub-symbols of C 3 r+ i = (q, B\ — k). This step is similar to that of recovering the T\ — (B t — k) 
columns of parity-check sub-symbols of C\ using C 3 = (Ti — (B\ — k), B\ — k) done above, except that 
B 3 = Ti — {B\ — k) is replaced by B 3>r+1 = q. 



Appendix E 
Proof Of CD) and (172)) 

One can get the result in (|7TI) through the following steps, 
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We use (|66l ) to remove the negative term before step (a). Similarly, we remove the negative term before 
step (c) using (l65l) . Steps (b) and (d) use the fact that source packets are independent of each other and 
of previous channel packets. 

The following steps help finding the result in (|72l , 
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Once again, we remove the negative term before step (e) using and (1671) . Steps (f) uses the fact that each 
source packet is independent of each other. 



Appendix F 
Proof Of ([83]) and © 

For the result in (l83l . we walk through the following steps, 
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The negative terms in (a) and (b) are removed using (f78T l and (T77T ) respectively. 
Next, we start by adding H(W k+1 \Wv) to both sides of d83j) to find ([84]) as follows: 
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The negative in (c) is removed using d79i Step (d) follows from the fact that source symbols are 
independent and (l84l) follows. 



The steps to get (|96l ) are, 
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Appendix G 
Proof Of d55b and d99 
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Step (a) is the addition of ( |93l ) and (|90l) , step (b) uses (|9TT) to remove the negative term in the previous 
step, and step (c) uses the fact that the source packets are independent of each other. The result is the 
form (|9^> for m = I + 1. 

While the working out to get (|99| ) is as follows, 
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where step (d) makes use of (|98l ). 
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